Topics
Latest
AI
Amazon
Image Credits:Utku Uçrak/Anadolu Agency / Getty Images
Apps
Biotech & Health
mood
Image Credits:Google
Cloud Computing
Commerce
Crypto
Image Credits:Google
Enterprise
EVs
Fintech
Fundraising
Gadgets
bet on
Government & Policy
ironware
layoff
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
Security
Social
distance
Startups
TikTok
transferral
Venture
More from TechCrunch
event
Startup Battlefield
StrictlyVC
Podcasts
video
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
Google is upgrade its visual hunting app , Lens , with the ability to answer near - real - time head about your surroundings .
English - speak Android and iOS users with the Google app installed can now startle capturing a video via Lens and require questions about objects of stake in the TV .
Lou Wang , managing director of product management for Lens , enounce the feature apply a “ custom-make ” Gemini fashion model to make sense of the video and pertinent questions . Geminiis Google ’s family of AI models and superpower a number of product across the company ’s portfolio .
“ Let ’s say you want to get wind more about some interesting fish , ” Wang said in a pressure briefing . “ [ Lens will ] produce an overview that explicate why they ’re swim in a lap , along with more resource and helpful information . ”
take a interrogation while recording a video , and Lens will tie out to an answer supplied byAI Overviews , the characteristic in Google Search that use AI to summarize information from around the World Wide Web .
accord to Wang , Lens expend AI to determine which frame in a video are most “ interesting ” and salient — and above all , relevant to the question being asked — and uses these to “ establish ” the solvent from AI Overviews .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
“ All this comes from an notice of how people are trying to utilize things like Lens right now , ” Wang say . “ If you lour the barrier of asking these interrogation and helping multitude gratify their curiosity , people are depart to pick this up passably course . ”
The launching of television for Lens comes on the blackguard of asimilar featureMeta preview last month for its AR glasses , Ray - Ban Meta . Meta plan to bring real - sentence AI video capabilities to the glasses , allow wearer require motion about what ’s around them ( e.g. , “ What eccentric of prime is this ? ” ) .
OpenAI has also card a feature that have itsAdvanced Voice Modetool understand video . Eventually , Advanced Voice Mode — a premiumChatGPTfeature — will be able to analyze videos in real metre and take setting into account as it answers you .
Google has trounce both company to the biff , it seems — minus the fact that Lens is asynchronous ( you ca n’t chat with it in real time ) , and assuming that the video feature article make for as advertised . We were n’t testify a alive demo during the insistency briefing , and Google has a account ofoverpromisingwhen it arrive to its AI ’s capabilities .
Aside from video analysis , Lens can also now search with images and textbook in one go . English - speaking user , include those not enrolled in Labs , can set in motion the Google app and carry the shutter button to take a photograph , then ask a question by speaking out loud .
ultimately , Lens is get down new eastward - commerce - specific functionality .
begin today , when Lens on Android or iOS recognise a mathematical product , it ’ll display entropy about it , admit the Leontyne Price and pile , brand , revue , and stock . Product ID works on uploaded and newly bust photos ( but not videos ) , and it is circumscribe to select countries and certain shopping categories , including electronics , toys , and beauty , for now .
“ get ’s say you run across a back pack , and you like it , ” Wang said . “ you could use Lens to describe that intersection and you ’ll be able to instantly see details you might be wondering about . ”
There ’s an advertising constituent to this , too . The termination page for Lens - identified products will also show “ relevant ” shopping ads with options and prices , Google enounce .
