Remove the power connector from the hard drive. The computer will boot from the CD (eventually - it may take a minute or two). Then, if you feel brave, you can hotplug the hard drive and continue.
But I agree that you have other problems. The keyboard should work at boot (else there would be no point in the "hold down C bit"). Have you tried it in more than one USB port? Have you tried a PC keyboard?