Topics

late

AI

Amazon

Article image

Image Credits:Bryce Durbin / TechCrunch

Apps

Biotech & Health

clime

OpenAI Advanced Voice Mode with vision

OpenAI employees demo ChatGPT’s Advanced Voice Mode with vision during a livestream.Image Credits:OpenAI

Cloud Computing

Department of Commerce

Crypto

OpenAI CEO Sam Altman speaks during the Microsoft Build conference at the Seattle Convention Center Summit Building in Seattle, Washington on May 21, 2024.

OpenAI’s end of the year event is here. The company is hosting “12 Days of OpenAI,” a series of daily…

Enterprise

EVs

Fintech

fundraise

Gadgets

Gaming

Google

Government & Policy

ironware

Instagram

layoff

Media & Entertainment

Meta

Microsoft

privateness

Robotics

Security

Social

Space

Startups

TikTok

Transportation

Venture

More from TechCrunch

case

Startup Battlefield

StrictlyVC

Podcasts

Videos

Partner Content

TechCrunch Brand Studio

Crunchboard

Contact Us

OpenAI has finally released the actual - time telecasting capabilities forChatGPTthat it demoednearly seven months ago .

On Thursday during a livestream , the ship’s company said thatAdvanced Voice Mode , its human - similar conversational feature for ChatGPT , is getting vision . Using the ChatGPT app , drug user support toChatGPT Plus , Team , orProcan point their speech sound at objects and have ChatGPT answer in near actual fourth dimension .

Advanced Voice Mode with vision can also read what ’s on a equipment ’s covert via screen sharing . It can excuse various preferences menus , for example , or give suggestions on a math problem .

To access Advanced Voice Mode with imagination , tap the voice ikon next to the ChatGPT chat bar , then beg the video icon on the bottom left , which will embark on video . To screen - part , tap the three - acid fare and pick out “ Share Screen . ”

The rollout of Advanced Voice Mode with vision will start Thursday , OpenAI says , and wrap up in the next week . But not all users will get access . OpenAI says that ChatGPT Enterprise and Edu ratifier wo n’t get the feature until January , and that it has no timeline for ChatGPT users in the EU , Switzerland , Iceland , Norway , or Liechtenstein .

In arecent demoon CBS News ’ “ 60 Minutes , ” OpenAI President Greg Brockman had Advanced Voice Mode with vision quiz Anderson Cooper on his anatomy skills . As Cooper drew organic structure parts on a blackboard , ChatGPT could “ see ” what he was drawing .

“ The location is spot on , ” ChatGPT said . “ The brainpower is the right way there in the question . As for the bod , it ’s a good start . The Einstein is more of an ellipse . ”

Join us at TechCrunch Sessions: AI

Exhibit at TechCrunch Sessions: AI

In that same demo , Advanced Voice Mode with vision made a misapprehension on a geometry problem , however , suggesting that it ’s prone tohallucinating .

sophisticated Voice Mode with sight has been delayed multiple times — reportedlyin part because OpenAI announced the feature far before it was output - ready . In April , OpenAI promised that Advanced Voice Mode would roll out to users “ within a few weeks . ” month later , the caller said itneeded more time .

When Advanced Voice Mode eventually arrived in other fall for some ChatGPT users , it lack the ocular psychoanalysis component . In the lead - up to Thursday ’s launching , OpenAI has focused its attention on land the voice - only Advanced Voice Mode experience toadditionalplatforms andusers in the EU .

Rivals like Google and Meta are working on exchangeable capabilities for their respective chatbot products . This week , Google made its actual - time , video - analyzing conversational AI feature , Project Astra , available to a group of “ trusted examiner ” on Android .

In plus to Advance Voice Mode with vision , OpenAI on Thursday launched a festive “ Santa Mode,”which tote up Santa ’s part as a preset part in ChatGPT . Users can find it by tapping or clicking the snow bunting icon in the ChatGPT app next to the prompt bar .

From the Storyline:Live Updates: 12 Days of OpenAI ChatGPT announcements and reveals

OpenAI ’s end of the year issue is here . The companionship is host “ 12 Days of OpenAI , ” a serial of daily …