removing rust

My husband recently purchased a used bike from a neighbor, but he didn't look it over well enough at that time and when we got it home we discovered rust in various places on the bike. What is the best way to remove the rust without damaging any of the delicate equipment? I was thinking of...