On most CPU heatsinks yes, but you can use a 3-pin fan. If that heatsink can be separated from the fan, then just get a fan like you said (some even include the MOLEX adapter in the package), or the heatsink I linked uses a 3-pin cable.
Plugging a power cable into a fan header can damage the system.