In all honesty, I remove my thermal paste with just a regular ole' paper towel. Just as long as you don't leave any residue, you should be fine. If you want to be extra safe, though, I'd at least advise regular rubbing alcohol. Don't drench the paper towel in alcohol. Only use about a light dab. Clean, rinse, repeat if its not all off in one go.