Start > Programs > Startup, see what's in there. If the program that you want to stop showing up is there, delete it. You can also see what the name of the windows is, and try to find a matching program that's installed, uninstall it.
May also be in the registry, but from your post I don't suggest you try to remove it from there, get someone who knows about computers to check it for you.