Is it ok to clean up Alkaline corrosion with vinyl gloves?

The alkaline paste inside standard batteries is not toxic and only mildly irritating. There's little risk in even handling it directly. Just don't eat it or get it in your eyes.