Depends on where the bootsector for your OS is located. If it is on the drive you remove, you can't boot.
Bootsector is usually if not always on C: drive but OS can be on any drive lettter.
Windows also tends to re-arrange drive letters when you remove Disk drives.