You can get pretty aggressive with stainless. I have smoothed stuff out with a file and proceeded from there to a polished surface. I even TIG welded cracks and used a hammer to form the metal flat prior to filing. With extensive material removal you will have a low spot, but you can loose a lot of defect if you blend the area over a large distance.