CPU Performance Boosted 20% When CPU, GPU Collaborate
Researchers have managed to get CPUs and GPUs on a single chip to work together more efficiently and boost performance.
Engineers at the North Carolina State University endeavored to improve the way both the CPU and the GPU perform by engineering a solution that sees the GPU execute computational functions, while the CPU cores pre-fetch the data the GPUs need from off-chip main memory. In the research team's model, the GPU and the CPU are integrated on the same die and share the on-chip L3 cache and off-chip memory, similar to the Intel's Sandy Bridge and AMD's APU platforms.
"Chip manufacturers are now creating processors that have a 'fused architecture,' meaning that they include CPUs and GPUs on a single chip," said Dr. Huiyang Zhou, an associate professor of electrical and computer engineering who co-authored a paper on the research.
"This approach decreases manufacturing costs and makes computers more energy efficient. However, the CPU cores and GPU cores still work almost exclusively on separate functions. They rarely collaborate to execute any given program, so they aren’t as efficient as they could be. That’s the issue we’re trying to resolve."
Zhou's solution was to have the CPU do the leg work by determining what data the GPU needs and then going and retrieving it from off-chip main memory. This in turn leaves the GPU free to focus on executing the functions in question. The result of this collaboration is that the process takes less time and simulations have found that the new approach yields an average improved fused processor performance of 21.4 percent.
The paper will be presented at the 18th International Symposium on High Performance Computer Architecture, in New Orleans, later this month. In the meantime, you can check out more details on the project here.
- AMD,
- CPU ,
- GPU ,
- APU ,
- fused-processor ,
- performance-boost
- Diablo 3 Won't Be Anywhere in Sight Until at Least Q2 2012
- Updated: Raspberry Pi Commercial Version in 3Q12
- Foxconn Hacked; Passwords and Logins Posted Online
- Microsoft Promises "Fair and Reasonable" Patent Licensing
- Deals Feb 9: 23" Core i5 AIO Touchscreen PC + Camera $949
- $100,000 If You Can Prove Quantum Computers Impossible
- Google Could be Planning a Retail Store in Dublin
- AMD Launches FirePro V3900 Professional GPU
- AMD Adds FM1 CPUs Athlon II X4 638 and Athlon II X4 641
- Hacker Says He Compromised Intel, Gained Private Info
- Possible AMD Radeon HD 7700 Series Specs Revealed
- Gabe Newell Gives Update on Steam Hack of 2011
- Apple Now Worth More than Google and Microsoft Combined
- Blizzard and Valve at War Over DOTA Name
- Deals Feb 11: HP dm4t Beats Core i5 + 1TB HDD Laptop $749
- Google Paid $410,000 for Chrome Bugs
- Download All the Torrents on The Pirate Bay in Only 90MB
- Epic Revealing Unreal Engine 4 Later This Year








Will this mean anything for the current generation of hardware?
Will this mean anything for the current generation of hardware?
nothing really, and don't game developers already know this and have been doing this for some time.
Is this anything significant? sounds like another Captain Obvious Statement
Will this mean anything for the current generation of hardware?
It could, if programmers get behind it.
Doesn't the Xbox 360 have the GPU and CPU on the same die?
I am sure the more experienced engineers at Intel and Nvidia are past what the college paper-writing academia oriented folks are doing.
It is probably already done, just to be released at a later date determined by their marketing release schedule.
in other news SSDs make your system faster
Not really news. An AMD chip most likely performs better coupled with an AMD graphics card. It would only make sense on their part.
Could this mean no more dedicated video cards in the future?
I hope not.
Well, transistors are reaching a physical limit, so we need any kind of optimization we can get. Let's hope this technology gets implemented soon...
Often when gaming, my gpus and vram are at or near 100% while my system CPU and Memory are no where near being maxed out. Seems to me if the system memory and cpu were given some of the workload.
I know they are talking about cpu and gpu being on the same chip in this article, but it seems to me better utilization across the board could be taking place.
Maybe lower budget gaming PCs will be able to get away with integrated video solutions in the future.
Isn't Intel and AMD already doing this?
Maybe lower budget gaming PCs will be able to get away with integrated video solutions in the future.
You are completely missing it. This research proves separate GPUs are STUPID. I've been saying for at least a year now that the integrated GPU is the future. Little by little, the Separate GPU is going to disappear until only the most extreme GPUs will remain as separate units. Eventually SOC will be the norm. RAM and BIOS will be integrated on a single die someday also.
Could this mean no more dedicated video cards in the future?I hope not.
When they get to the point where top video solutions are on the chip with the CPU, we'll all need one mother of a cooling solution.
Now this is an old idea but is becoming possible now....
First we had the CPU and graphical calculation were made by it.
Then they made the GPU and graphical calculations were shifted onto it.
Then they made the Sandy Bridge & The Llano which calculated the graphics with the help of a secondary Chip on board.
Now they're getting the CPU and the GPU onto one single die....
Lots of work... done... all for the same result....
Proper integration of command structure is not only a hardware issue, but also a software. For example, 3D rendering programs, which one would think would pull much of its data from the GPU during rendering, instead pulls all its power from the CPU (note I'm talking specifically about rendering). I would imagine that there should be some means of re-writing the code of a program like Maya or Modo so that the GPU helps out. It is a software instruction, after all, that allows for multiple cores or even multiple CPUs to work together.
I would think going the software route would not meet the efficiency angle these researchers seem to be looking at, but it might have better payoffs in terms of performance. Part of why CPUs with imbedded graphics controllers aren't more powerful than they are is that the heat generated is too much, something not really a problem if the GPU and CPU are on different dies as in a gaming rig. Again, APUs are more of an efficiency for low-power systems, not really performance. So the first uses of the ideas in this article will likely be either in smartphones, netbook/ultrabooks, tablets, or gaming consoles; any device that goes the SoC route. In short, means much more for the mobile industry than it does for enthusiasts and gamers.
But will it play Crysis?
You are completely missing it. This research proves separate GPUs are STUPID. I've been saying for at least a year now that the integrated GPU is the future. Little by little, the Separate GPU is going to disappear until only the most extreme GPUs will remain as separate units. Eventually SOC will be the norm. RAM and BIOS will be integrated on a single die someday also.
http://www.guru3d.com/article/amd- [...] -review/11
As long as you dont mind not being able to upgrade your graphics without upgrading your cpu and can put up with lowered fps and overall system performance... then yes apu's are "the future". Oh wait were you speaking of the idea that some people have been throwing about that tablet gaming is the future? yeah no.
This is why AMD had developed the APU.
nothing really, and don't game developers already know this and have been doing this for some time.
This is actually not true. Just FYI, credentials wise, I am a software engineer that doesn't work in gaming but plays plenty of games. I have used openGL / openCL / etc.
PC game developers now have a technology that allows them to compute almost all game logic GPU side - openCL / CUDA - where before that had to be done CPU side. It is why a game like World of Addictioncraft used a lot of CPU resources when it came out, because it did collision detection CPU side because they wrote the game for an openGL standard that didn't support general computation outside vector processing on GPUs.
Today, with openCL (you can't make a game that uses CUDA if its an Nvidia chip and something else if it is AMD when you can just write openCL and be cross GPU) you can do a lot of parallelizable things GPU side that were previously outside the vectorization paradigm openGL fixes processing on the GPU to.
And the general pipeline of a game engine, at its basic roots, is process input (user, network, in engine message passing) -> update state (each agent reacts on a tick stamp to game world events) -> collision detection (to prevent overlapping models) -> GPU rendering of the game world. Today, everything but processing input can be offloaded to the GPU and done massively parallel through openCL / openGL.
The next generation of games "should", if properly implemented, use so few processor resources besides file and texture streaming and processing key events and handling network packets that you might get 10% of one CPU utilized in an extremely high fidelity game that pushes the GPU to the limit but barely uses any CPU resources.
It also makes no sense to do any of those parallel tasks CPU side either - GPUs are orders of magnitude faster at that stuff. It is why an i5 2500k for $225 will last you a decade but you can spend $1500 on 3 7970s in triple Crossfire and have them be outdated by 2015. Games are moving into a completely GPU driven architecture for everything, and it is a good thing. It hugely increases the performance you can get from a game.
Is this anything significant? sounds like another Captain Obvious Statement
While the statement is kind of obvious, the work they have done isn't. If this can be included in commercial products, AMD's fusion will improve further in later hardware iterations.
While the statement is kind of obvious, the work they have done isn't. If this can be included in commercial products, AMD's fusion will improve further in later hardware iterations.
Yes, basically because they put some intelligence behind the decision of what goes to the GPU. There are some computational problems that do not make sense to send to a GPU because they are serial in nature, and would take just as long or longer to run on a GPU than they would on a CPU. Seti@Home had work units like this, and many contributors who run GPUs complained about this because it is an inefficient use of a GPU's power. Fortunately, the people who run Seti@Home listened and no longer send highly serial WUs to GPUs. It makes sense, to me at least, to intelligently decide what tasks are best suited for GPUs.
Well, transistors are reaching a physical limit, so we need any kind of optimization we can get. Let's hope this technology gets implemented soon...
they are close, but we are probably a good 10 or so years off of hitting the real limit, at least size wise.
if we ever figure out 3d, it could make a cpu well over twice as fast, and fit in a smaller footprint.
Could this mean no more dedicated video cards in the future?I hope not.
in the far future, yea, graphics cards are going to go the same way as sound cards. they will be fast enough to do damn newer everything for everyone, and the only people who want more will need a specialty item (probably wont be overly price inflated, due to size of the chips at the time)
This is actually not true. Just FYI, credentials wise, I am a software engineer that doesn't work in gaming but plays plenty of games. I have used openGL / openCL / etc.PC game developers now have a technology that allows them to compute almost all game logic GPU side - openCL / CUDA - where before that had to be done CPU side. It is why a game like World of Addictioncraft used a lot of CPU resources when it came out, because it did collision detection CPU side because they wrote the game for an openGL standard that didn't support general computation outside vector processing on GPUs. Today, with openCL (you can't make a game that uses CUDA if its an Nvidia chip and something else if it is AMD when you can just write openCL and be cross GPU) you can do a lot of parallelizable things GPU side that were previously outside the vectorization paradigm openGL fixes processing on the GPU to. And the general pipeline of a game engine, at its basic roots, is process input (user, network, in engine message passing) -> update state (each agent reacts on a tick stamp to game world events) -> collision detection (to prevent overlapping models) -> GPU rendering of the game world. Today, everything but processing input can be offloaded to the GPU and done massively parallel through openCL / openGL. The next generation of games "should", if properly implemented, use so few processor resources besides file and texture streaming and processing key events and handling network packets that you might get 10% of one CPU utilized in an extremely high fidelity game that pushes the GPU to the limit but barely uses any CPU resources.It also makes no sense to do any of those parallel tasks CPU side either - GPUs are orders of magnitude faster at that stuff. It is why an i5 2500k for $225 will last you a decade but you can spend $1500 on 3 7970s in triple Crossfire and have them be outdated by 2015. Games are moving into a completely GPU driven architecture for everything, and it is a good thing. It hugely increases the performance you can get from a game.
i dont like the idea of a game running soley on the gpu, look at physx on a lower end card, you have to scale it back to the point it may as well not be there to get the game running at higher framerates.
The way this is written, it makes it sound like a CPU is a memory controller and branch prediction unit. It's way off.
Ideally, you'd have the CPU schedule instructions in such a way they would seamlessly go to the GPU pipelines, much like you'd send a simple integer instruction down the correct pipeline. But, you'd still use the CPUs computational units for things it does better, and there a lot of things they do. Ever wonder why we've don't see GPU designs as CPUs running Operating Systems. They are good at what they do, but very poor at other things they don't do. Using the CPU as a memory fetcher and branch predictor is absurd.
AMD claims to have plans for things like this with their APUs in a few years, I think it was 2014. They want to have the graphics and CPU cores totally integrated and the CPU will not need software to tell it what work can be done faster on the GPU because it will be able to figure that out on it's own.
Let's see how far this goes.
Lol i read this years ago when AMD and NVIDIA where proposing HUR CUDA AND HUR OPENCL
years after i still cant find a damn usefull thing to do with these
AMD claims to have plans for things like this with their APUs in a few years, I think it was 2014. They want to have the graphics and CPU cores totally integrated and the CPU will not need software to tell it what work can be done faster on the GPU because it will be able to figure that out on it's own.
Let's see how far this goes.
If the system will automatically determine what code to run on CPU and what to run on GPU then will I need or not need to program in OpenCL?
nothing really, and don't game developers already know this and have been doing this for some time.
Is this anything significant? sounds like another Captain Obvious Statement
Today's games are pretty much one-way trip, CPU to GPU. What they talk about is "collaboration" between CPU and GPU - true heterogeneous computing, similar to what AMD is aiming with their HSA. The disadvantage of having GPU as an expansion card is the physical distance to CPU. The latency is high if data have to go from CPU to GPU and back. If discrete GPU is only doing the rendering, the one-way nature of it isn't much of a problem.
i dont like the idea of a game running soley on the gpu, look at physx on a lower end card, you have to scale it back to the point it may as well not be there to get the game running at higher framerates.
Today's GPUs are still too slow at context switching. The overhead and resource usage are still high when doing rendering and physics on a same card. While using CPU is good, it's still not the best for some highly parallel nature of physics. Using a dedicated GPU is better, but for a GPU it has transistors that are not needed for physics. That's why I think original Ageia's PPU is actually a good idea. It was a chip made solely for the physics.
that means the AMD fusion project are the future for computing, AMD bring it out, intel following it again