Topics
Latest
AI
Amazon
Image Credits:Michael Dodge/Fairfax Media / Getty Images
Apps
Biotech & Health
Climate
Image Credits:Michael Dodge/Fairfax Media / Getty Images
Cloud Computing
Commerce Department
Crypto
Image Credits:Kong
Enterprise
EVs
Fintech
fund-raise
Gadgets
punt
Government & Policy
ironware
Layoffs
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
Security
Social
Space
Startups
TikTok
Transportation
speculation
More from TechCrunch
Events
Startup Battlefield
StrictlyVC
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
API company Kong is launching its undefended beginning AI Gateway , an telephone extension of its live API gateway that allows developer and operations teams to integrate their applications with one or more big linguistic communication models ( LLMs ) and access them through a individual API . On top of this , Kong is found several AI - specific feature prompt engineering , credential direction and more .
“ We think that AI is an extra use case for APIs , ” Kong atomic number 27 - father and CTO Marco Palladino secernate me . “ APIs are driven by use cases : fluid , microservices — AI just happens to be the latest one . When we take care at AI , we ’re really search at genus Apis all over the place . We ’re looking at genus Apis when it comes to wipe out AI , we ’re looking at APIs to ok - melody the AI , and AI itself . [ … ] So the more AI , the more API usage we ’re going to have in the world . ”
Palladino argues that while virtually every organization is looking at how to utilize AI , they are also afraid of leak information . Eventually , he believe , these company will need to range their good example locally and mayhap apply the cloud as a fallback . For the time being , though , these companies also postulate to forecast out how to manage the credentials for access cloud - found models , restraint and logarithm dealings , manage quotas , etc .
“ With our API gateway , we wanted to bring home the bacon an offering that allow developers to be more productive when building on AI by being able-bodied to leverage our gateway to consume one or more LLM providers without accept to change their code , ” he noted . The gateway currently supports Anthropic , Azure , Cohere , Meta ’s LLaMA models , Mistral and OpenAI .
The Kong team indicate that most other API providers currently handle AI APIs in the same agency as any other genus Apis . Yet by layer these additional AI - specific features on top of the API , the Kong team believe , it can enable new utilisation lawsuit ( or at least make existing ones soft to implement ) . Using the AI response and request transformers , which are part of the new AI Gateway , developers can convert prompt and their results on the fly to automatically translate them or off personally identifiable information , for example .
Prompt engineering , too , is deeply integrate into the gateway , enabling businesses to enforce their road map on top of these models . This also means that there is a central head for managing these guidelines and prompt .
It ’s been almost nine years since thelaunch of the Kong API Management Platform . At the prison term , the caller that is now Kong was still bonk as Mashape , but as Mashape / Kong co - beginner and CEO Augusto Marietti told me in an interview before this week , this was almost a bit of a last - ditch campaign . “ Mashape was going nowhere and then Kong is the issue one API production on GitHub , ” he said . Marietti noted that Kong was cash - flow plus in the last twenty-five percent — and is n’t presently looking for funding — so that exploit out quite well .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
Now , the Kong Gateway is at the centre of the company ’s platform and also what power the young AI Gateway . Indeed , current Kong users only have to kick upstairs their current install to get access to all of the Modern AI feature of speech .
As of now , these unexampled AI features are available for free . Over fourth dimension , Kong have a bun in the oven to launch paid premium features as well , but the team stressed that this is not the finish for this current firing .
