Nvidia Files Patent For Hierarchical Graphics Processors

Filed earlier this year as an extension of the existing patent 7,634,637, Nvidia has applied for a patent that describes a hierarchical processor array. The idea is that there are two or three tiers of processing cores with dedicated functions that alleviates a problem in core design that results in increasingly wide and ineffective graphics rendering pipelines.

Those pipelines include various shaders, such as a vertex shader unit, a geometry shader, a pixel shader, among others, and each of these shaders are getting wider at every level of parallel execution hardware. Nvidia says that "each massively parallel stage in a stage-by-stage pipeline tends to provide little granularity of control of portions of each parallel stage", each "massively parallel stage becomes unwieldy and prohibitively time-consuming to design". Additionally, "the level of utilization may decrease, as the massively parallel stage struggles during operation to find sufficiently wide units of work to fully occupy the data path."

To keep parallelization efficient, the company describes a processor with multiple levels of processing hierarchies with "multiple classes of graphics operations being associated with a different stage of graphics processing." However, each level would also include at least one module that is capable of processing all graphics functions. There would also be one top-level component that is able to distribute certain classes of work to lower level classes of processors. The patent specifically mentions a third-level class in the processor hierarchy that would be reserved for general purpose computations, as well as "at least one" specialized graphics function module that "is capable of performing a class of graphics operations carried out based on frame buffer data for scan out to a display."

According to the patent application, the resulting core design is "advantageously configured to execute a large number of threads in parallel, where the term 'thread' refers to an instance of a particular program executing on a particular set of input data." For example, a thread would refer to the execution of a single vertex in the shader program or individual pixel being processed by the pixel shader.

Besides greater processing efficiency, the document states that a hierarchical structure of multithreaded core array also enables a faster design of "derivative chip designs." Faster GPUs could be built simply by "adding additional components at one or more of the levels of the hierarchy".

  • hannibal
    Holy Bat smoke! Bring the popcorn! Be ready for patent fights!
    This can not be good for customers...
  • Pherule
    The patent trolls have struck again...
  • digiex
    Nvidia is not a patent troll, they are actually the crown holder of the fastest GPU.
  • /\ /\ sorry i wish it was the fastest since Crysis, Metro 2033 and compute disagree. The 7970 is underclocked!
  • theconsolegamer
    Ok, so Nvidia wants to patent the GPU...... like are you serious?
  • sixdegree
    AMD should patent "innovative power regulator in graphic processor" while Intel patent "Data throttling through PCI express to graphic processor".
  • xingmaodr

  • ojas
    I think they've patented a method of increasing gpu efficiency, rather than "patent a GPU". I don't know too much about GPUs on an architectural level, but this is what i got out of the patent as described in the article.
  • Soda-88
    Frankythetoe/\ /\ sorry i wish it was the fastest since Crysis, Metro 2033 and compute disagree. The 7970 is underclocked!7970's die size is 352mm^2 whereas GTX680 is 294mm^2 (that's smaller than 560Ti). nVidia didn't have to release it's flagship (GK110) because 680 (should've been called 660) was trading blows with AMD's flagship card. Obviously, nVidia didn't wanna shoot itself in the foot by not seizing this opportunity to gobble as much cash as possible with the '680'.
  • sykozis
    PheruleThe patent trolls have struck again...How is nVidia a patent troll? nVidia has been the on the receiving end of the trolling as many times as Samsung has. nVidia is simply setting up for an entirely new architecture and properly filing for patents related to their work. This is actually what the patent system was setup for. If AMD or Intel want to follow suit, nVidia will license the patent to them.