Topics
recent
AI
Amazon
Image Credits:Ampere
Apps
Biotech & Health
mood
Image Credits:Ampere
Cloud Computing
Commerce
Crypto
Image Credits:Ampere
Enterprise
EVs
Fintech
Image Credits:Ampere
fund raise
appliance
Gaming
Government & Policy
Hardware
Layoffs
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
Security
Social
Space
Startups
TikTok
conveyance
Venture
More from TechCrunch
Events
Startup Battlefield
StrictlyVC
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
Ampere and Qualcomm are n’t the most obvious of partners . Both , after all , offer Arm - based chips for track down data center servers ( though Qualcomm ’s large market remains mobile ) . But as the two company announced today , they are now combining violence to bid an AI - focused server that uses Ampere ’s CPUs and Qualcomm ’s Cloud AI 100 Ultra AI inferencing chips for running — not prepare — models .
Like every other chip manufacturer , Ampere is looking to profit from the AI roar . The party ’s stress , however , has always been on fast and baron - effective server chips , so while it can use the Arm IP to tot some of these features to its chips , it ’s not necessarily a core competency . That ’s why Ampere decided to work with Qualcomm ( and SuperMicro to incorporate the two solutions ) , Arm CTO Jeff Wittich tells me .
“ The estimate here is that while I ’ll show you some great performance for Ampere CPUs running AI inferencing on just the CPUs , if you want to scale out to even bountiful models — multi-100 billion parametric quantity models , for instance — just like all the other workloads , AI is n’t one size of it jibe all , ” Wittich told TechCrunch . “ We ’ve been working with Qualcomm on this solution , combining our super effective Ampere CPUs to do a fate of the universal determination tasks that you ’re melt down in continuative with inferencing , and then using their really efficient cards , we ’ve got a server - storey solution . ”
As for partnering with Qualcomm , Wittich said that Ampere wanted to put together well - of - strain resolution .
“ [ R]eally good collaboration that we ’ve had with Qualcomm here , ” he said . “ This is one of the things that we ’ve been working on , I think we divvy up a lot of really similar interests , which is why I cerebrate that this is really compelling . They ’re building really , really efficient resolution and a lot of different part of the grocery . We ’re building really , really efficient solutions on the server central processing unit side . ”
The Qualcomm partnership is part of Ampere ’s annual roadmap update . Part of that roadmap is the new 256 - core AmpereOne buffalo chip , built using a modern 3 micromillimetre process . Those raw chip are not quite in the main available yet , but Wittich says they are quick at the fab and should revolve out later on this year .
On top of the additional centre , the define feature of this new generation of AmpereOne chips is the 12 - channel DDR5 RAM , which allows Ampere ’s datum center customers to good tune up their user ’ memory access according to their needs .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
The sales pitch here is n’t just performance , though , but the power consumption and cost to function these microprocessor chip in the information center . That ’s especially honest when it amount to AI inferencing , where Ampere like to compare its public presentation against Nvidia ’s A10 GPUs .
It ’s worth take down that Ampere is not sunsetting any of its be chips in favor of these unexampled one . Wittich stressed that even these erstwhile chips still have batch of usance lawsuit .
Ampere also announced another partnership today . The company is put to work withNETINTto build a joint result that pairs Ampere ’s central processing unit with NETINT ’s video processing micro chip . This new server will be able to transcode 360 live video communication channel in parallel , all while also using OpenAI’sWhisperspeech - to - text model to subtitle 40 current .
“ We started down this path six class ago because it is clean-cut it is the right path , ” Ampere CEO Renee James said in today ’s announcement . “ low-down mogul used to be synonymous with broken execution . Ampere has establish that is n’t unfeigned . We have pioneered the efficiency frontier of computing and deliver performance beyond legacy CPUs in an effective calculation envelope . ”
