A conductive paste on pins can cause a short circuit.
A non-conductive paste on pins can cause a loss of connection.
Either way, you gotta clean it. However, since you say you've already put the CPU back in, the damage is already done. You've already got paste in the socket. Just clean it off as best as you can and hope it doesn't cause problems in the future.