Uncovered EA patent would use AI to replace professional voice actors with (fake) you
Even the best version of this sounds like an unmitigated disaster
Amid ongoing concerns of AI acting in and outside of video games, Huzaifa Khan writing for Very Ali Gaming has stumbled on an EA games patent with some...very interesting implications. Namely, the EA games patent in question ("Generating speech in the voice of a player of a video game") is made with the goal of allowing for in-game characters to be fully voiced by the player.
In order for this functionality to work properly, lots of "input data" (meaning mostly speech samples, but also text samples) is required. Based on the patent, it seems like these goals could be accomplished either within game design or by sourcing external data (including from a server during gameplay).
The patent itself spends a considerable amount of time documenting the technical features of how input data is processed, but I'll be focusing on the game design implications here since they're more interesting. At least one game exists that already uses voice input data in an ongoing manner, though for conversations with NPCs instead of giving a voice to an onscreen character.
Inworld Origins is a short game from Inworld AI, a startup most recently in headlines for partnering with Xbox for AI NPC dialogue. Inworld Origins hinges around the player roleplaying as a detective and asking AI NPC characters questions, with answers generated on-the-spot based on that input.
So, there's little question that something like this is possible. It's so possible that recently, official English anime voice actors were openly speculating that they had been dubbed over with AI by Namco Bandai in the latest Naruto Ultimate Ninja Storm game. These comments were later denied by Namco themselves, but seemed likely at the time considering some of the exact scenes had been depicted with better voice lines in earlier games of the series.
Let's assume that this player-dubbing technology works near-flawlessly for the purpose of discussion, though. Mixed properly unlike the actual voice acting used in the above example, and using your voice unlike prior AI voice-in-gaming examples. Is this a feature you actually want to play a video game with?
Most video game playable characters already function primarily as self-inserts from a narrative perspective, but making that connection literal seems like a quick way to break immersion. Could you play as gravelly a Kratos as Christopher Judge? I know I couldn't.
Stay On the Cutting Edge: Get the Tom's Hardware Newsletter
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.
Considering the sheer scope of Electronic Arts and the funding available to them, I think they should just stick to hiring actual people for video game voiceover, especially for plot-critical characters. Adopting technology like this seems like a pretty sharp step backward from an industry that's been selling video games to us with face-scanned screen actors for the better part of the past decade. Does EA want prestige, or a six-year-old's voice coming from the mouth of John Slayer The Fifth, Last of His Kind?
Christopher Harper has been a successful freelance tech writer specializing in PC hardware and gaming since 2015, and ghostwrote for various B2B clients in High School before that. Outside of work, Christopher is best known to friends and rivals as an active competitive player in various eSports (particularly fighting games and arena shooters) and a purveyor of music ranging from Jimi Hendrix to Killer Mike to the Sonic Adventure 2 soundtrack.
-
randyh121 Why can't I just speak to the character? I'm all for AI in games in every way possible but this seems pointlessReply -
vanadiel007 I remember years ago Everquest Next was going to have dynamic NPC's that would be able to interact differently based on player input.Reply
Lot's of speculation on how that would work, and in the end it all fizzled out into nothingness.
This will be another one of those ideas. It's just a Company trying to sell their technology to a gaming company. -
-Fran- I guess it's cheaper than paying** for a good voice actor.Reply
I also hope it is opt-out, since I don't want EA forcing a EULA down my throat where I give them rights over my voice phonetics.
Regards. -
hotaru251 its just a way for them to get users to agree to having their voice stolen legally.Reply
its stupid & scummy. -
Alvar "Miles" Udell Is this a feature you actually want to play a video game with?
If it's done well? Yes. There's plenty of games which don't translate the speaking voice into other languages, have a vast number of speaking NPCs that just recycle the same few spoken lines, or even have spoken languages at all, but it'd have to sound natural and not like Alexa/Siri/Google Voice Assistant.
First, though, they need to develop AI that syncs lip movements to the language spoken -
JTWrenn It's EA. I almost guarantee this comes with some data collection bs that let's them add your voice to a library they will move in the future. The company is pretty gross.Reply -
ekio How can they get a patent for an idea thousands of people already had because it’s so basic ??Reply
The patent system in the US is really f$$ked up.