OpenAI’s GPT-4o brings us closer to the ‘Her’ experience

OpenAI held a webcast Monday to roll out a new version of its free ChatGPT app, which sounds and acts a lot like the AI in the 2013 Spike Jonze film, Her.

The experience is powered by a new version of its GPT-4 large language model—available on desktop and mobile—called GPT-4o (“GPT-four-oh”). The new model, OpenAI says, returns answers much faster than GPT-4, and improves on its text, vision, and audio capabilities.

The model is a showcase for OpenAI’s development of multi-modal AI. GPT-4o can recieve and reason about text, audio, and visual inputs, then deliver outputs in natural language and natural-sounding voice.

OpenAI researcher Mark Chen demonstrated the new model’s impressive conversational capabilities during a live demo. He told the chatbot that he was nervous about the demo, and asked her for advice to help calm down. Chen then mock-hyperventilated into phone, to which the app responded “Mark! You’re not a vacuum cleaner.” The AI was spontaneous and funny, much like the voice assistant (voiced by Scarlett Johansson) in Her, which has become a North Star for people developing consumer AI.

The app was asked to tell a story with various levels of “drama” in its voice, which it did, convincingly. The AI then told the same story in a stereotypical robot’s voice, and then again in sing-song fashion.

Chen also demonstrated how he could interrupt the AI voice, and she would quickly stop talking. ChatGPT, in other words, is getting more “emotionally” intelligent. This is very similar to what Inflection.ai was developing with its Pi AI app. But Inflection.ai was essentially bought out by Microsoft, the same tech giant that owns almost half of OpenAI.

The ChatGPT app also has the ability to “see” things and reason about them. Through the phone camera, the app was shown a math problem written on a white board and asked for help in working it out. It was then asked to explain some computer code. The app also did a live translation from Italian to English and back.

The new features in the ChatGPT app will roll out to users of the free version of ChatGPT over the next few weeks. OpenAI says it’s also making GPT-4o available to developers through its API. OpenAI’s live streamed announcement Monday seemed timed to steal some thunder from Google, which is expected to make a series of AI-related announcements at its I/O developer conference Tuesday.

https://www.fastcompany.com/91123206/openai-gpt-4o-announcement?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Created 11mo | May 13, 2024, 6:40:08 PM


Login to add comment

Other posts in this group

‘I’m going to go down swinging’: Meet the Florida entrepreneur taking on Trump’s tariffs in court

Business owners around the world are still reeling from the sky-high, globe-spanning tariffs President Donald Trump has announced since taking office. Last week, Emily Ley became the first to take

Apr 7, 2025, 6:40:07 PM | Fast company - tech
Silicon Valley isn’t pushing back on Trump’s immigration crackdown. It should be

President Donald Trump has just expanded the social media surveillance system for immigrants.

Starting in May, the United States will begin collecting the social media handles of all per

Apr 7, 2025, 11:50:04 AM | Fast company - tech
‘Teaching people how to avoid scams is better than helping someone who’s lost a ton of money’: Scambaiters are going viral on YouTube

Chances are, you or someone you know has been the target of a scam. According to the Federal Trade Commission (FTC), reported scams cost Americans

Apr 7, 2025, 7:10:04 AM | Fast company - tech
Will smartphone camera attachments ever be worth the hassle?

Smartphone cameras are still getting bigger and better by the year, particularly if you look at high-end phones coming out of China with huge sensors and protruding bumps to match. These phones ca

Apr 6, 2025, 10:20:03 AM | Fast company - tech
Apple just made it much easier to get a handle on your inbox. Here’s how

Keeping our inboxes organized often feels like an overwhelming task.

If you’r

Apr 5, 2025, 11:10:05 AM | Fast company - tech