There's a difference between bits and bytes. 100 megabit is not the same as 100 megabyte.
You probably meant 100KB per second, which is 1 megabit. If you get any lower either you have a bad ISP or you have a bad setup (lots of background downloading/uploading like a trojan horse or P2P application with unlimited upload running).