+1 on the rubbing alcohol, and a residue free cloth. Toilet paper and cheap paper towels leave behind the "fuzz".
I use cloth baby diapers for the job, each is good for thirty or so cleanings.
Do not forget to clean the cooler base or the waterblock too.