With all the latches and screws undone, try twisting it. If it still isn't coming away, correctly fasten all the screws etc up, run the system for a few minutes to heat up the CPU, then try again.
DO NOT run the system with the heat sink partially off unless you really want an excuse to upgrade early.