Download the Tom's Hardware App from the App Store
The reference for current tech news
Yes No
Ads

CPU Performance Boosted 20% When CPU, GPU Collaborate

by - source: NCSU

Researchers have managed to get CPUs and GPUs on a single chip to work together more efficiently and boost performance.

Engineers at the North Carolina State University endeavored to improve the way both the CPU and the GPU perform by engineering a solution that sees the GPU execute computational functions, while the CPU cores pre-fetch the data the GPUs need from off-chip main memory. In the research team's model, the GPU and the CPU are integrated on the same die and share the on-chip L3 cache and off-chip memory, similar to the Intel's Sandy Bridge and AMD's APU platforms.

"Chip manufacturers are now creating processors that have a 'fused architecture,' meaning that they include CPUs and GPUs on a single chip," said Dr. Huiyang Zhou, an associate professor of electrical and computer engineering who co-authored a paper on the research.

"This approach decreases manufacturing costs and makes computers more energy efficient. However, the CPU cores and GPU cores still work almost exclusively on separate functions. They rarely collaborate to execute any given program, so they aren’t as efficient as they could be. That’s the issue we’re trying to resolve."

Zhou's solution was to have the CPU do the leg work by determining what data the GPU needs and then going and retrieving it from off-chip main memory. This in turn leaves the GPU free to focus on executing the functions in question. The result of this collaboration is that the process takes less time and simulations have found that the new approach yields an average improved fused processor performance of 21.4 percent.

The paper will be presented at the 18th International Symposium on High Performance Computer Architecture, in New Orleans, later this month. In the meantime, you can check out more details on the project here.

Follow @JaneMcEntegart on Twitter for the latest news.      

Share:
51
Comments
X
Submit

Comments
Add your comment
pg3141 02/10/2012 3:46 PM
Hide
-16+

Will this mean anything for the current generation of hardware?

warezme 02/10/2012 3:55 PM
Show
greghome 02/10/2012 3:57 PM
Show
outlw6669 02/10/2012 3:57 PM
Hide
-8+

pg3141 wrote :

Will this mean anything for the current generation of hardware?



It could, if programmers get behind it.

Netherscourge 02/10/2012 4:05 PM
Show
hoofhearted 02/10/2012 4:22 PM
Hide
-4+

I am sure the more experienced engineers at Intel and Nvidia are past what the college paper-writing academia oriented folks are doing.

hoofhearted 02/10/2012 4:24 PM
Hide
-2+

It is probably already done, just to be released at a later date determined by their marketing release schedule.

alvine 02/10/2012 4:26 PM
Hide
-20+

in other news SSDs make your system faster

Star72 02/10/2012 4:38 PM
Show
drwho1 02/10/2012 4:40 PM
Show
vittau 02/10/2012 4:41 PM
Hide
-6+

Well, transistors are reaching a physical limit, so we need any kind of optimization we can get. Let's hope this technology gets implemented soon...

stingray71 02/10/2012 4:57 PM
Hide
-5+

Often when gaming, my gpus and vram are at or near 100% while my system CPU and Memory are no where near being maxed out. Seems to me if the system memory and cpu were given some of the workload.

I know they are talking about cpu and gpu being on the same chip in this article, but it seems to me better utilization across the board could be taking place.

digitalzom-b 02/10/2012 5:05 PM
Hide
-8+

Maybe lower budget gaming PCs will be able to get away with integrated video solutions in the future.

jaber2 02/10/2012 5:07 PM
Show
loomis86 02/10/2012 5:16 PM
Show
ubercake 02/10/2012 5:41 PM
Hide
-5+

drwho1 :
Could this mean no more dedicated video cards in the future?I hope not.


When they get to the point where top video solutions are on the chip with the CPU, we'll all need one mother of a cooling solution.

alyoshka 02/10/2012 5:42 PM
Hide
-6+

Now this is an old idea but is becoming possible now....
First we had the CPU and graphical calculation were made by it.
Then they made the GPU and graphical calculations were shifted onto it.
Then they made the Sandy Bridge & The Llano which calculated the graphics with the help of a secondary Chip on board.
Now they're getting the CPU and the GPU onto one single die....
Lots of work... done... all for the same result....

DRosencraft 02/10/2012 5:44 PM
Hide
-4+

Proper integration of command structure is not only a hardware issue, but also a software. For example, 3D rendering programs, which one would think would pull much of its data from the GPU during rendering, instead pulls all its power from the CPU (note I'm talking specifically about rendering). I would imagine that there should be some means of re-writing the code of a program like Maya or Modo so that the GPU helps out. It is a software instruction, after all, that allows for multiple cores or even multiple CPUs to work together.

I would think going the software route would not meet the efficiency angle these researchers seem to be looking at, but it might have better payoffs in terms of performance. Part of why CPUs with imbedded graphics controllers aren't more powerful than they are is that the heat generated is too much, something not really a problem if the GPU and CPU are on different dies as in a gaming rig. Again, APUs are more of an efficiency for low-power systems, not really performance. So the first uses of the ideas in this article will likely be either in smartphones, netbook/ultrabooks, tablets, or gaming consoles; any device that goes the SoC route. In short, means much more for the mobile industry than it does for enthusiasts and gamers.

hajila 02/10/2012 5:44 PM
Show
shin0bi272 02/10/2012 5:52 PM
Hide
-2+

loomis86 :
You are completely missing it. This research proves separate GPUs are STUPID. I've been saying for at least a year now that the integrated GPU is the future. Little by little, the Separate GPU is going to disappear until only the most extreme GPUs will remain as separate units. Eventually SOC will be the norm. RAM and BIOS will be integrated on a single die someday also.



http://www.guru3d.com/article/amd- [...] -review/11

As long as you dont mind not being able to upgrade your graphics without upgrading your cpu and can put up with lowered fps and overall system performance... then yes apu's are "the future". Oh wait were you speaking of the idea that some people have been throwing about that tablet gaming is the future? yeah no.

aznjoka 02/10/2012 6:08 PM
Hide
-3+

This is why AMD had developed the APU.

Zanny 02/10/2012 6:14 PM
Hide
-12+

warezme :
nothing really, and don't game developers already know this and have been doing this for some time.



This is actually not true. Just FYI, credentials wise, I am a software engineer that doesn't work in gaming but plays plenty of games. I have used openGL / openCL / etc.

PC game developers now have a technology that allows them to compute almost all game logic GPU side - openCL / CUDA - where before that had to be done CPU side. It is why a game like World of Addictioncraft used a lot of CPU resources when it came out, because it did collision detection CPU side because they wrote the game for an openGL standard that didn't support general computation outside vector processing on GPUs.

Today, with openCL (you can't make a game that uses CUDA if its an Nvidia chip and something else if it is AMD when you can just write openCL and be cross GPU) you can do a lot of parallelizable things GPU side that were previously outside the vectorization paradigm openGL fixes processing on the GPU to.

And the general pipeline of a game engine, at its basic roots, is process input (user, network, in engine message passing) -> update state (each agent reacts on a tick stamp to game world events) -> collision detection (to prevent overlapping models) -> GPU rendering of the game world. Today, everything but processing input can be offloaded to the GPU and done massively parallel through openCL / openGL.

The next generation of games "should", if properly implemented, use so few processor resources besides file and texture streaming and processing key events and handling network packets that you might get 10% of one CPU utilized in an extremely high fidelity game that pushes the GPU to the limit but barely uses any CPU resources.

It also makes no sense to do any of those parallel tasks CPU side either - GPUs are orders of magnitude faster at that stuff. It is why an i5 2500k for $225 will last you a decade but you can spend $1500 on 3 7970s in triple Crossfire and have them be outdated by 2015. Games are moving into a completely GPU driven architecture for everything, and it is a good thing. It hugely increases the performance you can get from a game.

rohitbaran 02/10/2012 6:36 PM
Hide
-1+

greghome :
Is this anything significant? sounds like another Captain Obvious Statement


While the statement is kind of obvious, the work they have done isn't. If this can be included in commercial products, AMD's fusion will improve further in later hardware iterations.

wiyosaya 02/10/2012 7:09 PM
Hide
-1+

rohitbaran :
While the statement is kind of obvious, the work they have done isn't. If this can be included in commercial products, AMD's fusion will improve further in later hardware iterations.


Yes, basically because they put some intelligence behind the decision of what goes to the GPU. There are some computational problems that do not make sense to send to a GPU because they are serial in nature, and would take just as long or longer to run on a GPU than they would on a CPU. Seti@Home had work units like this, and many contributors who run GPUs complained about this because it is an inefficient use of a GPU's power. Fortunately, the people who run Seti@Home listened and no longer send highly serial WUs to GPUs. It makes sense, to me at least, to intelligently decide what tasks are best suited for GPUs.

alidan 02/10/2012 7:23 PM
Hide
--2+

vittau :
Well, transistors are reaching a physical limit, so we need any kind of optimization we can get. Let's hope this technology gets implemented soon...



they are close, but we are probably a good 10 or so years off of hitting the real limit, at least size wise.
if we ever figure out 3d, it could make a cpu well over twice as fast, and fit in a smaller footprint.

drwho1 :
Could this mean no more dedicated video cards in the future?I hope not.



in the far future, yea, graphics cards are going to go the same way as sound cards. they will be fast enough to do damn newer everything for everyone, and the only people who want more will need a specialty item (probably wont be overly price inflated, due to size of the chips at the time)

Zanny :
This is actually not true. Just FYI, credentials wise, I am a software engineer that doesn't work in gaming but plays plenty of games. I have used openGL / openCL / etc.PC game developers now have a technology that allows them to compute almost all game logic GPU side - openCL / CUDA - where before that had to be done CPU side. It is why a game like World of Addictioncraft used a lot of CPU resources when it came out, because it did collision detection CPU side because they wrote the game for an openGL standard that didn't support general computation outside vector processing on GPUs. Today, with openCL (you can't make a game that uses CUDA if its an Nvidia chip and something else if it is AMD when you can just write openCL and be cross GPU) you can do a lot of parallelizable things GPU side that were previously outside the vectorization paradigm openGL fixes processing on the GPU to. And the general pipeline of a game engine, at its basic roots, is process input (user, network, in engine message passing) -> update state (each agent reacts on a tick stamp to game world events) -> collision detection (to prevent overlapping models) -> GPU rendering of the game world. Today, everything but processing input can be offloaded to the GPU and done massively parallel through openCL / openGL. The next generation of games "should", if properly implemented, use so few processor resources besides file and texture streaming and processing key events and handling network packets that you might get 10% of one CPU utilized in an extremely high fidelity game that pushes the GPU to the limit but barely uses any CPU resources.It also makes no sense to do any of those parallel tasks CPU side either - GPUs are orders of magnitude faster at that stuff. It is why an i5 2500k for $225 will last you a decade but you can spend $1500 on 3 7970s in triple Crossfire and have them be outdated by 2015. Games are moving into a completely GPU driven architecture for everything, and it is a good thing. It hugely increases the performance you can get from a game.



i dont like the idea of a game running soley on the gpu, look at physx on a lower end card, you have to scale it back to the point it may as well not be there to get the game running at higher framerates.

ta152h 02/10/2012 7:24 PM
Hide
-1+

The way this is written, it makes it sound like a CPU is a memory controller and branch prediction unit. It's way off.

Ideally, you'd have the CPU schedule instructions in such a way they would seamlessly go to the GPU pipelines, much like you'd send a simple integer instruction down the correct pipeline. But, you'd still use the CPUs computational units for things it does better, and there a lot of things they do. Ever wonder why we've don't see GPU designs as CPUs running Operating Systems. They are good at what they do, but very poor at other things they don't do. Using the CPU as a memory fetcher and branch predictor is absurd.

blazorthon 02/10/2012 7:46 PM
Hide
-0+

AMD claims to have plans for things like this with their APUs in a few years, I think it was 2014. They want to have the graphics and CPU cores totally integrated and the CPU will not need software to tell it what work can be done faster on the GPU because it will be able to figure that out on it's own.

Let's see how far this goes.

caskachan 02/10/2012 9:55 PM
Hide
--3+

Lol i read this years ago when AMD and NVIDIA where proposing HUR CUDA AND HUR OPENCL

years after i still cant find a damn usefull thing to do with these

IndignantSkeptic 02/10/2012 10:02 PM
Hide
-0+

blazorthon wrote :

AMD claims to have plans for things like this with their APUs in a few years, I think it was 2014. They want to have the graphics and CPU cores totally integrated and the CPU will not need software to tell it what work can be done faster on the GPU because it will be able to figure that out on it's own.

Let's see how far this goes.




If the system will automatically determine what code to run on CPU and what to run on GPU then will I need or not need to program in OpenCL?

Th-z 02/10/2012 11:21 PM
Hide
-2+

warezme :
nothing really, and don't game developers already know this and have been doing this for some time.


greghome :
Is this anything significant? sounds like another Captain Obvious Statement



Today's games are pretty much one-way trip, CPU to GPU. What they talk about is "collaboration" between CPU and GPU - true heterogeneous computing, similar to what AMD is aiming with their HSA. The disadvantage of having GPU as an expansion card is the physical distance to CPU. The latency is high if data have to go from CPU to GPU and back. If discrete GPU is only doing the rendering, the one-way nature of it isn't much of a problem.

alidan :
i dont like the idea of a game running soley on the gpu, look at physx on a lower end card, you have to scale it back to the point it may as well not be there to get the game running at higher framerates.



Today's GPUs are still too slow at context switching. The overhead and resource usage are still high when doing rendering and physics on a same card. While using CPU is good, it's still not the best for some highly parallel nature of physics. Using a dedicated GPU is better, but for a GPU it has transistors that are not needed for physics. That's why I think original Ageia's PPU is actually a good idea. It was a chip made solely for the physics.

sonofliberty08 02/10/2012 11:59 PM
Hide
--1+

that means the AMD fusion project are the future for computing, AMD bring it out, intel following it again


Ads

Best offers

Newsletters


OK
Ads