This is a USB hard drive you're speaking of? It can be plugged in after the Mac is started or before. To "properly" remove it you would unmount it first, by pressing Control when clicking on the drive icon on the desktop and selecting remove drive from the menu