Mice don't have speakers so it can't come from there. If it's in your regular speakers check your system sounds. Set them to default.
The sound in not coming through the speakers but is in the Mouse itself as if the sound is travelling up the wire from the PC USB port. I have tried two different mice and the problem/sound is identical.