ChatGPT Glasses Bring AI Into Your Real Life

News
By Mark Tyson
published

rizzGPT has big glasshole energy.

rizzGPT using the Monocle AR
(Image credit: Bryan Hau-Ping Chiang)

While a lot of people have been having fun chatting with OpenAI’s ChatGPT, one Stanford student has found a new use for the large language model: interacting with others in the real-world. 

Computer science and electrical engineering student Bryan Hau-Ping Chiang has made ChatGPT portable and interactive thanks to open source Monocle AR hardware and OpenAI’s Whisper automatic speech recognition (ASR). A smartphone is currently used within the setup, too. These combined technologies have been given the catchy name rizzGPT ("Rizz" is slang for "charisma") by Chiang. Guided in real-time, Chaing has used the AI chat assistant during events such as a mock job interview, a chance meeting with a friend, and choosing the best dishes at a new restaurant.

(Image credit: Bryan Hau-Ping Chiang)

In a guide to rizzGPT, shared on Twitter, Chiang describes the system as the start of “a new era of ambient computing enabled by AR + AI, where everyone has their own personal assistant available 24/7.” More briefly, and humorously, rizzGPT can be used during life events like awkward dates and job interviews, providing “real-time Charisma as a Service (CaaS),” quips the Stanford student.

See more

A great example of rizzGPT in action is provided by the Tweet embedded above. In the video an AI-enhanced Chiang aces a set of interview questions, using the discrete Monocle AR gadget clipped to the frame of his glasses. The built-in display of the Monocle feeds him an autocue of AI-perfected answers direct from ChatGPT.

(Image credit: Bryan Hau-Ping Chiang)

Another personal interactive situational use of the rizzGPT system is provided when Chiang bumps into a friend. The AI has learned who his friends are, trained using photos, and can recognize them. The connected Monocle wearer is able to conjure up relevant conversations based on smartphone messages exchanged with any particular friend. This could easily be deployed on "awkward dates", so wearers can autopilot a brilliant conversation. That being said, others around you may not be so thrilled to see you wearing glasses that scan their face and tell you what to say. There are some echoes of Google Glass here.

(Image credit: Bryan Hau-Ping Chiang)

One more compelling example of AI agents combined with Monocle AR is for providing menu advice at a restaurant. In this Tweeted video you can see that the AI reads the menu (silently) for Chiang, and when verbally quizzed provides some spoken advice based on what it knows of his food likes and dislikes – and nutritional values. The Stanford student also leverages connected services for speech transcription, TTS, and OCR in this real-world AI application.

If you can think of any other fun use cases for rizzGPT, Chiang is asking for DMs, so don’t be shy to send suggestions.

Mark Tyson
Mark Tyson
Freelance News Writer

Mark Tyson is a Freelance News Writer at Tom's Hardware US. He enjoys covering the full breadth of PC tech; from business and semiconductor design to products approaching the edge of reason.

7 Comments Comment from the forums
  • bit_user
    I figured this was where Google Glass was eventually going, but with more emphasis on visual cues. Like, it'd use face recognition to show people's names above their heads, and could give you a history of when you last talked to them and about what, in a sidebar.

    I even had the idea of keying off audio cues and doing google searches, to provide context. But, ChatGPT really changes the game, in conversations.

    BTW, it's illegal to make audio recordings of people without appropriate warning. You can film or photograph people in public places, but not secretly make audio recordings of them. Not retaining the audio could land this in a legal grey zone, but it's not one I'd want to test in court.
    Reply
  • Marvin Martian
    Resistance is futile. You will be assimilated.
    Reply
  • BX4096
    bit_user said:
    BTW, it's illegal to make audio recordings of people without appropriate warning. You can film or photograph people in public places, but not secretly make audio recordings of them.
    That's not necessarily true. The legality of this varies largely from country to country. In case of the US, that depends on the state, with the majority of states allowing it, if I recall correctly.

    EDIT: just checked, at least 37 US states allow it. The EU is different, since they have union-wide data protection regulation that prohibits it, but the rest of the countries are split. Countries like India, Sweden, or Japan allow it; countries like Canada, Australia, or the UK prohibit it. Case by case basis.
    Reply
  • bit_user
    BX4096 said:
    That's not necessarily true. The legality of this varies largely from country to country. In case of the US, that depends on the state, with the majority of states allowing it, if I recall correctly.

    EDIT: just checked, at least 37 US states allow it. The EU is different, since they have union-wide data protection regulation that prohibits it, but the rest of the countries are split. Countries like India, Sweden, or Japan allow it; countries like Canada, Australia, or the UK prohibit it. Case by case basis.
    Yes, I was talking about the US. Thanks for clarifying that. However, would you clarify which you are referring to: audio or video recording?
    Reply
  • edzieba
    using the discrete Monocle AR gadget
    I'm not sure whether this was merely a typo, or a deliberate pun on the device being very much not discreet and also a single display.
    Reply
  • PEnns
    Because the Google Glass was not dorky enough.. now we have the Borg Glasses.

    As to help with "awkward dates", dream on!!
    Reply
  • USAFRet
    bit_user said:
    Yes, I was talking about the US. Thanks for clarifying that. However, would you clarify which you are referring to: audio or video recording?
    Video recording in public is almost always allowed.

    Audio recording - you often have to get permission from all parties involved.
    Varies by state.
    Reply