Internal is cheaper, faster, and less likely to get kicked probably.
Find out what type your old one is (IDE? SATA?) - get another one with that interface, and plug it in. It's pretty easy, they even come with directions. Make sure the one you buy is compatible with your OS.