Tech, ExplainedHealthtech and life sciences
Part

Ambient scribe API

A scribe built into someone else's record.

INSIDE: AI MEDICAL SCRIBEHOW IT WORKS · A SCRIBE INSIDE A PHYSIOTHERAPY RECORDThe record maker addsa Record button forits 3,000 clinicsDuring a 30-minutesession, the appsends the audio tothe scribe serviceWithin about a minuteof the end, theservice returns adraft noteThe note comes in therecord's sections:pain score,exercises, kneemovement, planThe app places eachsection in its field,and the therapistchecks and signs itINSIDE: AI MEDICAL SCRIBEHOW IT WORKS · A SCRIBEINSIDE A PHYSIOTHERAPY RECORDThe record maker adds aRecord button for its3,000 clinicsDuring a 30-minutesession, the appsends the audio tothe scribe serviceWithin about a minute ofthe end, the servicereturns a draft noteThe note comes in therecord's sections: painscore, exercises, kneemovement, planThe app places eachsection in its field, andthe therapist checks andsigns itINSIDE: AI MEDICAL SCRIBE · A SCRIBE INSIDE APHYSIOTHERAPY RECORDThe record maker adds a Record button forits 3,000 clinics↓During a 30-minute session, the app sendsthe audio to the scribe service↓Within about a minute of the end, theservice returns a draft note↓The note comes in therecord's sections: pain score,exercises, knee movement, plan↓The app places each section in its field,and the therapist checks and signs it
A physiotherapy record maker's app sends a 30-minute session's audio to the ambient scribe API and receives a draft note in the record's own sections, which it places in its fields for the therapist to sign.
opens a page inside this one a page in the same scene a page in another scene a concept page a label only, with no page

An ambient scribe API is a service through which the makers of patient records build an AI medical scribe into their own product, instead of building one themselves. Here, an API is a set of instructions that one program can send to another over the internet. The record maker's software sends the recording of a visit to the scribe company's service, and receives a draft note in return. Products like this are sold mainly to record makers whose customers are in the United States.

Why would a record maker not build its own scribe? Building one needs speech recognition that understands medical words, a language model that writes good notes, and years of testing with doctors. A company that makes records for physiotherapists, or for eye clinics, cannot easily build all of that. But its customers now expect a scribe. So it rents one from a specialist, and shows the scribe inside its own screens, under its own name.

Consider a company that makes the record used by 3,000 physiotherapy clinics in the United States. Its engineers add a Record button to their app. During a 30-minute session, the app sends the audio to the scribe service as the session goes on. When the session ends, the service sends back a draft note within about a minute. The note is not one block of text. It is divided into the sections that the physiotherapy record uses: the patient's pain score, the exercises done, how far the knee bends, and the plan for the next session. The app places each section in its own field. The physiotherapist checks the note and signs it, as with any AI medical scribe.

The hard part is fitting the note to the record's own fields. A general scribe writes a note for a family doctor. A physiotherapy note needs different sections and different words. So the service lets each record maker define its own note template, and the language model fills it in. Picking the right facts out of the conversation for each field is a task of clinical NLP.

The record maker usually pays the scribe company a fee for each doctor or therapist who uses the scribe each month. It may charge its own customers extra for the feature, or include it in its price.

Many software companies face the same choice in other areas: build a feature themselves, or add a specialist's feature to their own product. In payments, adding a specialist's payment service to a product is called embedded payments. Behind the scribe service are models for speech and language, described in speech and voice AI.

Tech, Explained is a part of ingrid.fyi. Every page explains one piece of technology in plain words.