MLOps and LLMOps platforms

Training and running models 9 companies

Training a model needs many GPUs working together, and running it for millions of users needs servers that grow and shrink with demand. These companies sell the software for both.

Training and running models

Spreading the work over many GPUs, and serving the model to users.

AnyscaleAnyscale is the company behind Ray, the free software that spreads the training and running of models across many GPUs. It has engineers in Bengaluru.BengaluruHired recently

TrueFoundryTrueFoundry, founded in Bengaluru, sells a platform on which a company runs, scales and watches its models and agents on its own cloud account.BengaluruHired recently

G42G42, the Abu Dhabi AI group, builds AI clouds and models for single countries, run under their control. It has engineers in Bengaluru.

SandLogicSandLogic, a Bengaluru company, builds models and the software to run them on a device, such as a camera or a phone, instead of in a data centre.

hosted-aihosted·ai sells software that turns a room full of GPUs into a cloud that a provider can rent out.See alsoCloud infrastructure and web hosting providers

Building models without a data scientist

Software that builds a model from a table of data automatically.

H2O.aiH2O.ai, with engineers in Bengaluru, sells software that builds a model from a table of data automatically, without a data scientist.

RapidCanvasRapidCanvas, with engineers in Mumbai, sells the same kind of automatic model building to business users, with AI agents on top.

Quantum computing next to AI

Platforms that offer quantum computers and AI on the same cloud.

Qubrid AIQubrid AI, in Kolkata, also sells a cloud that offers both quantum computing and AI.KolkataHiring now

QpiAIQpiAI, in Bengaluru, sells a platform that offers quantum computing and AI on the same cloud.

The tech, explainedDistributed computing framework Model deployment platform Sovereign AI cloud Edge AI Automated machine learning (AutoML)Quantum computing cloud

Gateways, agents and retrieval 5 companies

A gateway sends each request to the right model provider. An agent framework lets a model use tools and work towards a goal. Retrieval finds the right documents and gives them to the model with each question.

Lyzr AILyzr AI, with engineers in Bengaluru, sells a framework for building agents that run inside a large company's own systems.Bengaluru

Concentrate AIConcentrate AI, a Bengaluru start-up, sells a gateway that sends each request to a model provider, switches to another when one is down, and tracks what the company spends.

PipesHubPipesHub, a three-person Bengaluru company, sells a free, open-source agent framework, with the connectors through which an agent reads a company's documents.

NugenNugen, with engineers in Mumbai, sells models trained for one field, such as finance or law, which other apps call over the internet.

Wand AIWand AI sells a platform for AI agents that do office work. It is here for the systems those agents run on.BengaluruHired recentlySee alsoEnterprise AI agent platforms

The tech, explainedLLM gateway AI agent framework Retrieval-augmented generation (RAG)Domain-specific language models

Training data and model testing 7 companies

A model learns from labelled examples, such as a question paired with its correct answer. Once trained, it must be tested before release and watched once it is live.

Labelled data for training

Experts who write the examples and feedback models learn from.

Surge AISurge AI's expert writers produce the examples and the feedback on which the largest language models are trained. It hires in Delhi, Mumbai and Chennai.Delhi NCR · Mumbai · Chennai

DATAmundiDATAmundi, in Bengaluru, labels speech and language data for training models.

Testing and watching models

Checking a model's answers before release and while it is live.

Lexsi LabsLexsi Labs, in Mumbai, is the research arm of Arya.ai. It builds tools that show what a model has learned from the inside, and tools that make models smaller.MumbaiHired recently

GalileoGalileo, with engineers in Bengaluru, sells tools that test a model's answers and watch them once it is live.

Fiddler AIFiddler AI, also in Bengaluru, sells tools that watch models in use and explain their answers.

Maxim AIMaxim AI tests AI agents by running them through simulated conversations, before and after they are released.

RagaAI Inc.RagaAI tests models and the systems that find documents for them.

The tech, explainedData labelling AI interpretability and alignment

How it all worksGenerative AI applicationsTurning a language model into a Hindi support assistant.

See how it works →

What's changing

Agents are becoming the typical app.

Many of these companies expect that the typical app of the next few years will be an agent: a model that uses tools and works towards a goal. Each agent needs a gateway, access to documents, memory and testing, which is the software these companies sell.