If you are working with an AMD CPU and mainboard, then you will have FCPGA (Flip-Chip Pin Grid Array). This means the pins are on the processor and the mainboard has receptacles in the socket for these pins. All the earlier advice should work fine for straightening bent pins on the processor as long as the pins don't break. Be EXTREMELY gentle when you are doing this.
However, if you are working with an Intel CPU P4 and up, then you are most likely dealing with an LGA (Land Grid Array) socket. The pins are on the mainboard socket and the processor has the grid array that sit on these pins. The weight of the CPU will lay the pins down flat, thus ensuring contact between the pin and the corresponding grid point on the CPU.
LGA pins, though, are extremely delicate and small. Once one is bent out f place, it almost never sits right on the CPU. Hance, if anyone ever comes to me and tells me that they have damaged an LGA socket, my primary advice to them is to replace the mainboard. Chances are very high that it would not qualify for an RMA unless you can prove that it was damaged before purchase (i.e., crushed box, etc.).
Right now, you are taking a chance that one of the LGA pins is bent the wrong way and is crossed over on other pins or is connecting with other grids. You could have very well already damaged your CPU and will probably have to replace it along with your mainboard. Such is the change you take, though.
Buy a new mainboard, install the CPU, and test test test the hell out of it, just like you were overclocking. If you are lucky, all is OK. If not, buy a new CPU and chalk up the expense to learning through experience rather than the wisdom of watching someone else doing it.