The thumb drive won't leave anything on your computer unless you copy it there. Or maybe it has a virus on it that's causing a problem.
Simply plugging a thumb drive in does nothing, accept give you access to the data it contains. You didn't happen to click on a setup file did you?