Topics
Latest
AI
Amazon
Image Credits:Google DeepMind
Apps
Biotech & Health
clime
Image Credits:Google DeepMind
Cloud Computing
Commerce
Crypto
A first look at Project Mariner.Image Credits:Google
Enterprise
EVs
Fintech
Here’s what Project Mariner looks like when in use.Image Credits:Google
Fundraising
gizmo
bet on
Government & Policy
Hardware
Layoffs
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
security system
Social
Space
inauguration
TikTok
Transportation
speculation
More from TechCrunch
Events
Startup Battlefield
StrictlyVC
newssheet
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
Google unveiled on Wednesday its first - ever AI broker that can take action on the internet , a research paradigm from the company ’s DeepMind division called Project Mariner . The Gemini - powered agent take ascendency of your Chrome web internet browser , move the cursor on your covert , clicks buttons , and fills out forms , allowing it to use and navigate websites much like a human would .
The ship’s company is start out by exhaust its AI agent to a small group of preselected testers on Wednesday , Google says .
Google is continuing to experiment with new ways for Gemini to interpret , summarize , and now use websites . A Google executive director tell TechCrunch this is part of a “ fundamentally young UX paradigm shift ” : moving drug user off from directly interact with site , and instead interacting with a generative AI system that does it for you .
These shift could affect millions of commercial enterprise — from publisher like TechCrunch , to retail merchant like Walmart — which have historically bank on Google to send literal people to visit and use their internet site .
In a demonstration with TechCrunch , Google Labs music director Jaclyn Konzelmann showed how Project Mariner works .
After setting up the AI federal agent with an filename extension in Chrome , a chat window pops up to the right of your browser app . you’re able to instruct the factor to do things like “ create a shopping cart from a food market store based on this listing . ”
From there , the AI agent navigate to a grocery entrepot ’s website — in this case , Safeway — and then look for for and added items to a practical shopping cart . One thing that ’s straightaway evident is how dense the agentive role is : There were about 5 seconds of time lag between each pointer movement . At times , the agent stopped its project and reverted back to the chat windowpane , asking for clarification about certain items ( how many carrots , etc . ) .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
Google ’s factor can not check up on out , as it ’s not supposed to fill out credit card numbers racket or charge information . Project Mariner also wo n’t accept cookies for user or sign a terms of service understanding . Google enounce it purposefully does n’t admit the agent to do these things , in orderliness to give users more control condition .
Behind the view , Google ’s agent is take screenshots of your web browser windowpane , something users must jibe to in the term of service of process , and sending them to Gemini in the swarm for processing . Gemini then sends didactics back to your computer to navigate the web page .
Project Mariner can also be used to detect flights and hotel , store for household point , find recipe , and other tasks that presently require user to click through the web .
One major caveat is that Project Mariner only works on a Chrome web browser ’s first active tab , which means you ca n’t apply your computer for other things while the agent works in the screen background — you need to watch Gemini slow tick around . Google DeepMind ’s chief engineering officer , Koray Kavukcuoglu , enunciate this was a very knowing decisiveness so that user have a go at it what Google ’s AI agent is doing .
“ Because [ Gemini ] is now taking actions on a substance abuser ’s behalf , it ’s important to take this step - by - whole step , ” said Kavukcuoglu in an interview with TechCrunch . “ It ’s completing . You , as an individual , can use websites , and now your agent can do everything that you do on a website as well . ”
Website owners may be salvage to learn that Google ’s AI factor works on your computer screenland , because that means publishing house and retail merchant still get your eyeball on their Page . However , Google ’s AI agentive role could mean that user are less engaged with the internet site they chatter , and one day , it may not require users to use these websites at all .
“ [ Project Mariner ] is a fundamentally new UX paradigm shift that we ’re seeing right now , ” Konzelmann secernate TechCrunch . “ We need to visualize out what is the correct way for all of this to change the way users interact with the web , and the elbow room publishers can create experience for users , as well as for agents , in the future . ”
Besides Project Mariner , Google on Wednesday also unveiled several other AI agent for more specific labor .
One AI federal agent , Deep Research , draw a bead on to help substance abuser search complex topics by creating multistep research plans . It seems to contend with OpenAI ’s o1 , which can also do multistep logical thinking . However , a Google spokesperson remark the agentive role is not design to resolve mathematics and logical reasoning problems , compose code , or do datum analysis . The AI agent is rolling out in Gemini Advanced today and will come to the Gemini app in 2025 .
When actuate with a unmanageable or big question , Deep Research will create a multistep action programme to answer it . After the substance abuser okay the design , Deep Research takes a few minutes to correct the interrogative and search the web and then sire a lengthy report on its finding .
Another new AI broker from Google , Jules , aims to assist developers with coding project . It integrates now into GitHub workflow , reserve Jules to consider your existing work and make changes flat in GitHub . Jules is cast out to a select mathematical group of beta quizzer today and will be available later in 2025 .
at long last , Google DeepMind say it ’s shape on an AI agent to help you navigate video games , work up on its foresightful history of creating biz - flirt AI . Google is make for with biz developers , like Supercell , to essay Gemini ’s ability to construe gambling mankind such as Clash of Clans . Google did n’t declare oneself any release day of the month for this prototype but enounce this employment is helping them work up AI agents that help voyage forcible worlds , as well as virtual ones .
It ’s unclear when Project Mariner will roll out to Google ’s monolithic user foundation , but when they do , these agents will have a meaning encroachment on the broader web . The World Wide Web is designed for humans to use it , but Google ’s AI agents could change that standard .
