Is it only MP3 players that have this issue?
I believe XP will look in a number of places for drivers. Standard locations are the /inf directory you already mentioned but windows also has \windows\system32\drivers which on my machine contains just over 300 files, 13 of which start with the letters USB (ie. USBCAMD.sys, usbport.sys, usbhub.sys)