What the CPU and GPU do are totally different, so that would not work anyway.
The CPU might have 6 cores, but the typical GPU has hundreds. 1,024 for my HD 7850 (which is NOT bleeding-edge). A CPU core can do the same work of a GPU core* in the same period of time, (assuming equal clock speeds) so using my system as an example:
900 MHz GPU clock frequency
4.3 GHz CPU clock frequency
4 cores in the CPU
4.3 x 4 * 0.9 = 19.1.
In other words, in my case, I'd be adding about 19 cores worth of work capacity, to a card that already has over a thousand. A drop in the bucket.
*The CPU is designed to handle complex instructions, in a given amount of time. It can do simple instructions as well, but not any faster than a complex...