You probably don't need to take the lever off. If the levers are silver, just wet sand the scratches with some 300 grit sand paper. If you have the black ones, sand off the scratch and use some automotive touch up paint. Not perfect looking, but you won't be able to feel it while you're riding.