GPU repair service will upgrade the 11GB of VRAM on your RTX 2080 Ti to 22GB — mod involves physically adjusting the strap resistors on the PCB to support a new BIOS

GeForce RTX 2080 Ti Founders Edition
(Image credit: Nvidia)

Limits on the amount of VRAM on Nvidia's consumer GPUs have forced the modding community to take matters into their own hands. Time and again we've seen various DIY memory upgrades being performed, and it's even offered as a proper repair service in underground markets, but rarely is it done openly. As such, we've just spotted a vendor that will upgrade the 11GB of VRAM on an RTX 2080 Ti to 22GB and provide the BIOS for it upfront — no shady back-alley deals required.

Latest Videos FromTom's Hardware
Hassam Nasir
Contributing Writer

Hassam Nasir is a die-hard hardware enthusiast with years of experience as a tech editor and writer, focusing on detailed CPU comparisons and general hardware news. When he’s not working, you’ll find him bending tubes for his ever-evolving custom water-loop gaming rig or benchmarking the latest CPUs and GPUs just for fun.

  • usertests
    Is a 2080 Ti 22 GB really desirable for AI? It should be significantly worse than a 4060 Ti 16 GB.

    RTX 3070 16 GB is fun for everyone, if the price is right.
    Reply
  • hotaru251
    usertests said:
    Is a 2080 Ti 22 GB really desirable for AI?
    yes.
    even if its "slower" than a modern gpu the increased vram is what you want to run larger models and only GPU nvidia offers above 16gb is their 90 sku which is a small fortune.
    Reply
  • Lamarr the Strelok
    How can this be a "reasonable upgrade" if you don't know how much it costs? Seriously, come on.
    Reply
  • JamesJones44
    Deleted member 2824971 said:
    No, is what I'd say, because those older GPUs are missing support for the smaller quantizations and ML optimized data types to squeeze more inference into the same amount of RAM.
    I would say it depends. Having enough VRAM to fit the entire model can still beat having to transfer parts over system memory with faster/optimized hardware. I just depends on what you are doing and the size of the model.

    That being said, 22GB vs 16GB of VRAM isn't all that significant of a difference, you might be able to go from 10 billion parameter 8 bit model to 16 billion parameter model fitting in VRAM, that's unlikely to help most workloads.
    Reply
  • Lamarr the Strelok
    To be clear this is the only time Ive had a problem with Hassam's work.He's usually very very good.Not a huge deal just a bit annoying is all.
    Reply
  • usertests
    Deleted member 2824971 said:
    No, an RTX 2080ti with 22GB of RAM may extend the gaming side of that chip, but for machine learning, I am ready to bet a case of beer, that upgrading an existing RTX 2080ti is rubbish vs buying RTX 5000 cards new.
    Underwhelming for AI, and I don't imagine the 2080 Ti needs more than 11 GB for gaming very often. It's on par with the RX 9060 XT 8GB and RTX 3070 8GB in TPU: https://www.techpowerup.com/gpu-specs/geforce-rtx-2080-ti.c3305
    Nobody named the price of these mods, but that's probably what will make it look decisively worse than newer-gen 16 GB options. Maybe people in the UAE need to go these lengths?
    Reply
  • Lamarr the Strelok
    Deleted member 2824971 said:
    They sell news.

    They are desperate.
    Why exactly are they desperate? They're no different than other sites that fall over themselves making pathetic excuses for Nvidia in general.And that's been on the wane recently here too, thankfully.

    So yeah, not even close compared to other sites. Surprised there are no allegations of authors using AI instead of real reporters.Or reporters are afraid of losing their jobs to AI,so they're desperate for some reason.AI won't replace people in journalism. Real news anyway.
    Reply
  • JamesJones44
    Deleted member 2824971 said:
    I've looked at videos describing the double RAM upgrades for RTX 4090, much closer not only to my heart, but also to professional cards sold by Nvidia.

    From what I can tell, the upgrade is quite involved and requires both highly skilled labor and components that aren't cheap.

    For anyone thinking about sending his RTX 2080ti in for an upgrade, the quoted price is likely to be beyond purchasing an RTX 5070ti new would cost, the latter even including a warranty... sometimes.

    And that point it makes no sense to go down that road.

    I've gone through the core Wikipedia article and it confirms what I remember: the RTX 2080ti is a Turing generation device, which means its main ML related improvements are a bit of INT4, INT8 and FP16 support.

    INT4 and INT8 are fast, but very imprecise, impacting quality or hallucinations and they also don't yet seem to be supported at comparable scale than with the successors: in a way Turing was a very short-lived/underpeforming generation on both sides, consumer and AI.

    FP16 turned out to be a bad match for ML, it's optimizing precision at the cost of scale, a better match for HPC and engineering than neural network simulation: that's why starting with Google the industry quickly went with "brain floats" or BF16, which offers more range and less precision. Today that's often an intermediate format used for training and tuning, but later carefully quantified to 8 or 4 bit sized data types for speed in inference.

    And there it's a race with plenty of bespoke formats, all trading bits for speed vs quality, four bit float formats that share exponents across whole vectors surfing the waves.

    That means an RTX 5000 able to manage those floating 4-bit weights can pack 4x as many of them as a Turing GPU using an FP16 format unsuited for ML...

    No, an RTX 2080ti with 22GB of RAM may extend the gaming side of that chip, but for machine learning, I am ready to bet a case of beer, that upgrading an existing RTX 2080ti is rubbish vs buying RTX 5000 cards new.

    If I asked my son to give me his RTX 2080ti to verify that claim, he'll want an RTX 4070 I keep as a spare as a stand-in. And then I fully expect he'll never want to swap back again, because the RTX 4070 beats the 2080ti in pretty near everything, except energy consumption.

    I've had a similar issue when we dissolved our ML lab two years ago. It had quite a few V100 with 16GB of HBM in it, which I knew could even capably run games via remote frame buffer tech (essentially something like Steam remote play, those GPUs don't have a video output). But their only advantage was supporting BF16, which couldn't compete even with an RTX 3090 sporting 24GB of GDDR6 in terms of model size.

    While generational progress for games in Nvidia GPUs may be put in question or even been laughed at, when it comes to ML and inference, each generation was a big bang: not all Nvidia GPUs are the same!
    I think we are talking about two different use cases. I would never expect a company or professional to use a RTX 2080ti with 22 GB of RAM or even a 5070 ti for that matter, if we are talking FP16, 16 GB of RAM isn't enough to run anything meaningful. In that scenario I am also a hard no.

    However, depending on the price, for the home person/tinkerer who just wants to run LM Studio, OpenClaw, etc. to run agents to draft replies, manage schedules, etc. (those who are flying Mac minis off the shelf) it could be valuable if the price was right, but that's a big if.
    Reply