Very Strange Keyboard Problem

I think that this has to do with intalling Internet Explorer 6, but it might just be a coincidence.
Anyway, I just got around to upgrading Explorer, and things were a little shakey but I finally got it to work properly. Foolishly, I had it install some of the alternate language support programs, and promptly uninstalled them, [I'd never use em and I am a psycho when it comes to shutting down all but the essentials,] but then I noticed that there was a problem.
Whenever I type a quotation mark, [in anything, be it IE, Word, etc.,] nothing really happens at first. When I hit the next key, both that letter and the quote then appears. Doesn't sound all that bad? About half the letters seem to take this hidden quote and make it into an accented version of itself. For instance, quote+e will make an e with an accent, from French. This means that I have to press space after each quote I type, in order to move on.
This is VERY ANNOYING.

This is such a wierd problem, I doubt any of you will know how to fix it, but oh well, it's worth trying. I've already tried to look through Microsoft's unbelievably useless support site, but to no avail.

I'm using:
Windows ME
Microsoft Natural Keyboard Pro