Video shows world's first Neuralink brain interface patient playing PC games and chess with his mind

Screencap of Civilization VI gameplay taken from the official Civ VI YouTube channel.
The premiere Neuralink gaming experience, according to its first patient. (Image credit: Firaxis Games)

A nine minute video posted today showed the world's first nueralink patient playing video games with his mind. The professed Charles Xavier fan, paralyzed man and lapsed chess player describes being grateful for Elon Musk's controversial Neuralink brain interface project after it allowed him to pick Chess and other games back up. We've embedded the full video below (expand tweet to see the video).

One of the first times Neuralink's first human patient was given full reign of the brain interface, he proceeded to "stay up until [...] 6 A.M. playing Civilization VI," enjoying the new input method like a true gamer. Due to the sheer scale and time investment of Civ 6, paralysis would have prevented him from having a proper gaming binge, but Neuralink made it possible.

For the video demonstration, the Neuralink subject is mainly testing online Chess, but the Civ 6 comments make clear that it's suited for long-term use. When learning controls, he first started differentiating attempted and imagined movement. Then, he mentally 'moved' his left and right hands and finally just focused on cursor movements. According to him, this feels akin to "Force Manipulation" in Star Wars.

The main form of control seems to be staring at a spot on the screen in order to move the cursor there and click. This actually sounds a lot like existing eye-tracking software, which can be applied to existing webcams without brain surgery.

The main downside described by the patient is the eight-hour battery life on the unit. He seems quite happy with it otherwise.

Before closing the video, it's clear that the first-ever Neuralink patient is optimistic about its future. We hope he's right. He also encourages other people who want to be human testers for an input device requiring brain surgery to sign up. His optimism is understandable, but we wouldn't recommend anyone rush into being a tester unless they're fully comitted.

Like last time, it's important to remember that these brain implants have allegedly killed several apes, and Elon Musk still denies that to be the case to this day. There may be more promise in eye-tracking camera software that doesn't require brain surgery as well, if cursor control is really all this Neuralink is capable of. 

  • punkncat
    This is an astounding level of coolness.
    Reply
  • vanadiel007
    I think his true plans are to someday connect his brain to the neuralink, so he can eventually just keep the neuralink and live forever.

    I like the guy, but I also think he's sometimes dreaming a bit too much.
    Reply
  • cyrusfox
    Agree with the authors Christopher Harper] conclusions
    There may be more promise in eye-tracking camera software that doesn't require brain surgery as well, if cursor control is really all this Neuralink is capable of.
    Was hoping for more seamless direct control rather than the current stated solution. Hopefully more features are developed for these users and they survive and have a richer life due to this tech and its future advancements.
    Reply
  • bit_user
    I dreamed about doing something like this, ever since I saw a public TV program showing some guy steering his boat by using electrodes attached to his head. That was some 30 years ago. Can't believe it took this long to achieve the level of finesse needed for gaming, but I guess it's cool that it finally happened.

    I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:
    "The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.

    Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."

    https://www.cnbc.com/2024/02/29/musks-neuralink-brain-implant-company-cited-by-fda-over-animal-lab-issues.html
    Reply
  • Bikki
    With brain interface we can do much more than controlling the cursor. With ten thousands of link channels he could literally control Jaeger in pacific rim. To compare it to eye tracking is premature. They're testing very narrow use-case for now to improve whatever tools they using for decoding-encoding, and the precision is already pretty good. Wait until you see he controls the computer faster than any human could, typing with his thought and open apps just by thinking Netflix.
    Reply
  • parkerthon
    I think this is cool, but I’m still highly skeptical of the technology being safe. Have to start somewhere though. The first humans for everything. The risks are pretty obvious. I’m not sure knowing it failed on a few chimps by causing fatal brain bleeds would change the minds of people this intent on trying it first. They are already trapped by paralysis. They are trying to be part of history frankly.
    Reply
  • parkerthon
    Bikki said:
    With brain interface we can do much more than controlling the cursor. With ten thousands of link channels he could literally control Jaeger in pacific rim. To compare it to eye tracking is premature. They're testing very narrow use-case for now to improve whatever tools they using for decoding-encoding, and the precision is already pretty good. Wait until you see he controls the computer faster than any human could, typing with his thought and open apps just by thinking Netflix.
    This technology is coming someday. I still think it’ll be a while. We know very little about the brain. It is quite difficult to study in a live patient with the technology we have. To that end I think this technology is still very primitive compared to what is possible with something even more fantastical such as, say, nanomachines in our blood. This method is highly invasive and dangerous whatever the results end up being. I’m sure to be the first though, it has to be amazing.
    Reply
  • Trake_17
    bit_user said:
    I dreamed about doing something like this, ever since I saw a public TV program showing some guy steering his boat by using electrodes attached to his head. That was some 30 years ago. Can't believe it took this long to achieve the level of finesse needed for gaming, but I guess it's cool that it finally happened.

    I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:
    "The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."https://www.cnbc.com/2024/02/29/musks-neuralink-brain-implant-company-cited-by-fda-over-animal-lab-issues.html
    Before you go all Lawnmower Man on Neuralink, those are VERY mild audit results. If you've ever been audited, every single of one of those could and probably does have an explanation like "oh, we've never actually used that device and have a process to ensure it gets calibrated before we do". You gotta know better than to take things at face value anymore. There often more QA rules than you can shake a stick at, which doesn't mean they aren't important, only that missing a couple is practically inevitable and doesn't itself mean you're generally irresponsible.
    Reply
  • Trake_17
    parkerthon said:
    This technology is coming someday. I still think it’ll be a while. We know very little about the brain. It is quite difficult to study in a live patient with the technology we have. To that end I think this technology is still very primitive compared to what is possible with something even more fantastical such as, say, nanomachines in our blood. This method is highly invasive and dangerous whatever the results end up being. I’m sure to be the first though, it has to be amazing.
    Yo, they have EEG caps that can, with recognizable resolution, reproduce an image you're thinking of.
    Reply
  • atomicWAR
    bit_user said:
    I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:
    "The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."https://www.cnbc.com/2024/02/29/musks-neuralink-brain-implant-company-cited-by-fda-over-animal-lab-issues.html
    This is a tough one I have some personal experience with as a paraplegic. While I would have great pause having such a surgery myself and I have had many due to my injury from carpal tunnel, cubital tunnel, spinal surgery and the list goes on...I would be extremely cautious about something this invasive in the brain.

    The most problematic surgeries for me included being fitted with a Medtronic pump (twice plus a final removal...more on that in a sec) that sent medication directly to my spinal fluid allowing the baclofen that had a difficult time breaking the blood brain barrier when taken orally...to just be absorbed by my grey matter directly (brain and spinal cord) to control my spasms as I would frequently stand up out of my chair at that time and then collapse to the ground (spinal cord memory based spasm) or just spasm so violently in every muscle below my level of injury chucking myself out of the chair like a flopping fish out of water. Spoiler it was not fun and it took a long time to learn to control. Bringing my point back around as to why I'd have pause for an implant brain surgery as many of these procedures have some serious to straight up detrimental side effects they frequently don't do the best job warning you about.

    I broke two of those Medtronic pumps within weeks to months of their install for example. One of those times I had ripped the catheter out of my spinal canal, was told it should have killed me from the withdrawal from baclofen as apparently it is extremely addictive when given via spinal fluid. And the second one they have zero idea why it broke. They just knew that it didn't pump dye out the catheter while doing active xray to detect it so there was no question the meds weren't making it out into my spinal canal...so yet again I dodged a lethal bullet from withdrawal they could not explain. And then there was the spinal meningitis I got when they removed the pump altogether when I refused to have a third put in, which really did try to kill me as I spent a month plus in the hospital recovering. Oh and for a bonus my spinal fluid drained every time I sat up for three of those weeks, even though I was told that was impossible...I'd either pass out or scream in pain according to the neurosurgeons if that were to happen...then a nurse saw it happen actively. The scar where they pulled the catheter out of my spine leaked spinal fluid profusely. They were shocked at my pain tolerance to handle my spinal fluid leak. I was also told later this leak was likely the cause of my meningitis as the leak gave a direct path for infection of my spinal fluid/canal.

    My larger elongated point is for traumatic injuries like his, mine, etc. Quality of life considerations can sometimes make you willing to overlook potential risks from surgical intervention, even when you shouldn't ever think about it. Mexican stem cell therapy in the 90s-00s I am looking at you...popular when I was first injured but I saw it for the scam it was but some of my peers were not so lucky and it typically cost them their lives or diminished their quality of life severely and they had to pay for that 'privilege' out of pocket as insurance never covered it, for good reason (death, tumors, cancer, infections,etc).

    As a paraplegic any game out there is typically playable in one fashion or another for me. Thus gaming has been a sanctuary for me as has building/repairing PCs. As someone pre-SCI I was a huge adrenaline junky...I raced on alpine skis in HS but was more known for my extremely high jumps/ cliff jumps. I loved jumping off cliff's on skis or high/cliff diving (started in 3rd grade), plus I skateboarded, rode mountain bikes, played football, soccer, etc etc. Going from that kind of lifestyle which is statistically common lifestyle among SCI patients (as is being a male 18-24...I was 20 and 21 for my spinal injuries) to a chair was a jarring experience to say the least and while I continued to do extreme sports like WCMX, football, downhill mountain biking, for some things I had to take that quality of life choice into consideration. I imagine it is the same thing for this guy. I mean hey he can game a little better now and likely play more games then he could prior with time and training.

    Sometimes a short to medium term win that mostly likely ends with a long term loss is better than no win at all. So I can respect why this guy was willing to take this risk. To be fair someone has to do it at some point or no advancement would ever happen. All that said with the risk involved and track record of Neurolink as a whole, I don't know if I would have made the same choice but then again...who knows I am not a quadriplegic. Maybe if I was I'd see things much differently. I choose to take medication, for example, that ups my dementia risk because they make my pain and spasms tolerable. Its a choice many like myself are forced to make at one point or another. They are not easy choices to be taken lightly.

    I do applaud this result in a patient and I hope for more/better advancements in the future yet I also fear how those desperate enough from an injury can and likely will be taken advantage of to achieve success. Now if someone has acclimated to their disabled lifestyle (typically takes 5 years according to therapist/docs) so they aren't being irrational trying to 'regain' their old life as many newly injured do, plus they understand all the risks involved (I mean all and not the extremely abbreviated cliff notes versions you typically get at best IME) and they are aware just how much of a guinea pig they're being, then more power to them. Heck I have guinea pigged a few times myself in test groups over the course of my injury with higher than FDA approved dosing on gabapentin...now approved as the new upper limit, I was in a control group for a medication test on paraplegics as I was already capable of physical function they were testing as an incomplete SCI (ie I can move with intention below my injury, much of my sensation is intact, etc) and they needed that to compare against paraplegics that were complete injuries with no feeling or movement...like a fully severed cord for example...to see if it worked for them as well as it did incompletes like me.

    Anyways I look forward to seeing how this tech progresses but I do hope people won't disregard the cost in animal and human life in achieving such advancements. I fear thus far, that hasn't been the case enough of the time. Patients like this deserve out utmost respect and understanding, regardless if you'd be willing to do the same. So kudos and may the force be with him. (force mouse cracked me up)
    Reply