10 to the 23 AI logo

Domain Atlas / Clinical decision support & deterioration alerting

Case fileUnited States (Kaiser Permanente Northern California; 21 hospitals)large deployment

Advance Alert Monitor (AAM) deterioration model

Explore this deployment in the PAN Lab ↗

The Advance Alert Monitor is an in-hospital deterioration model running around the clock across 21 hospitals of an integrated health system, scoring inpatients hourly and firing roughly twelve hours before predicted deterioration; a 2020 New England Journal of Medicine evaluation associated its alert-driven rapid-response workflow with lower mortality. Its defining feature is where the alert goes: not to the bedside, but to a dedicated regional tier of critical-care virtual quality nurse consultants who screen every alert around the clock, work up the chart, and only then escalate to the on-site rapid-response team — so the measured benefit is priced against the whole two-tier staffing topology, not the model alone.[2]

What happened

The Advance Alert Monitor (AAM) is an in-hospital deterioration model deployed across 21 hospitals of an integrated health system. It scores inpatients hourly from the electronic health record and raises an alert roughly twelve hours before predicted clinical deterioration. A 2020 evaluation in the New England Journal of Medicine associated the alert-driven rapid-response workflow with lower mortality across the deployment.

What makes this deployment structurally distinctive is not the model but where its alert goes. The alert does not fire at the bedside. It goes to a dedicated regional tier of critical-care virtual quality nurse consultants who screen every alert around the clock, work up the patient's chart, and only then escalate to the on-site rapid-response team. A screening operator class sits between the model and the bedside — a two-tier topology. That screening tier does two jobs at once. It is an oversight function: it absorbs the model's false-alarm load so the bedside never sees the noise. And it is a standing cost: a 24/7 regional nursing subsystem that exists only to service the model's output.

The consequence for how the benefit should be read is precise. The measured mortality effect is priced against the whole topology, not the model alone. Remove the screening tier and the measured effect has no mechanism — the alerts would arrive raw at a bedside with no time to work them up, and the false-alarm load the tier currently absorbs would land on the people least able to absorb it. The existence of the screening tier is itself evidence about the raw alert stream: a system that builds a dedicated 24/7 function to screen its alerts before anyone acts is telling you the unscreened stream is too noisy to act on directly. As with the other clinical evaluations in this domain, the study is developer-affiliated — built and evaluated inside the deploying system — which is a strength of access and a limit on independence at the same time.

The sociotechnical reading

Most of this Atlas asks whether a human loop exists and whether it survives the workload. AAM asks a different question: what does a working human loop cost, and is that cost on the books? Here the governance is not a policy or a checkbox — it is a payroll. The alert's entire benefit runs through a dedicated, 24/7, regional tier of critical-care nurses whose single job is to screen the model's output before anyone at the bedside is interrupted. That tier is simultaneously the oversight (it catches and absorbs the false alarms) and the cost (a standing nursing subsystem that exists only because the model does). The honest way to state the deployment's benefit is inseparable from that subsystem: the NEJM mortality association is a property of model-plus-screening-tier, and a reader who quotes the benefit while imagining the model alone is quoting a number that was never measured.

The governable surfaces follow from that. The first is the temptation to save money by thinning or removing the screening tier once the model is trusted — which does not make the tool cheaper, it removes the mechanism the benefit ran through and pushes the false-alarm load onto the bedside. The second is that the screening tier's own capacity is the real constraint: a tier that is understaffed relative to the alert volume degrades into a rubber stamp, and the two-tier topology quietly collapses back into an unscreened alert flood. The third, shared with the rest of this domain, is independence: the evaluation was run inside the deploying system, so the strongest evidence is developer-produced, and the standing check that would confirm it — a validation and re-authorization by a party with no stake — is not in the record. The honest boundary throughout: no patient or clinical outcome is computed on the Lab diagram. The patients being scored are boundary-only; the alerts, screenings, and escalations are institutional signals, and the mortality association and the staffing cost live in the case file, never on any network.

The concepts used in this reading are defined in the Field Guide; the governance responses live in the Practice Library. The model organization for this case can be stress-tested in the PAN Lab.

Grounding sources for this case

The same sources that ground this model organization in the PAN library: evaluations, government documents, investigative reporting, and advocacy documentation, each labeled by tier.

escobar2020aGroundingPeer-reviewedSave

Escobar, G.J., Liu, V.X., Schuler, A., Lawson, B., Greene, J.D., & Kipnis, P. (2020). Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration. New England Journal of Medicine, 383(20), 1951-1960. https://doi.org/10.1056/NEJMsa2001090 https://www.nejm.org/doi/full/10.1056/NEJMsa2001090

doi.org/10.1056/NEJMsa2001090

Appears in: PAN framework development

Grounds: domain grounding: clinical decision support (sepsis/deterioration alerting, imaging triage)

thekaiserpermanentenorthernc2022GroundingAcademicSave

The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration (2022). Joint Commission Journal on Quality and Patient Safety. https://www.jointcommissionjournal.com/article/S1553-7250(22)00110-6/fulltext

https://www.jointcommissionjournal.com/article/S1553-7250(22)00110-6/fulltext

Appears in: PAN framework development

Grounds: domain grounding: clinical decision support (sepsis/deterioration alerting, imaging triage); model org: kaiser_aam_deterioration

Topics: ai-safety

Seeing your organization in this case file?

The histories here are documented after the harm. Mapping a live deployment's pathways and pressures, before the incident report, is engagement work: intake, diagnosis, prescription, and monitoring, with every limitation stated.

Sources & Evidence

Claims made on this page and what supports them. The full registry lives in Evidence.

EmpiricalThe Advance Alert Monitor is an in-hospital deterioration model running around the clock across 21 hospitals o…

The Advance Alert Monitor is an in-hospital deterioration model running around the clock across 21 hospitals of an integrated health system, scoring inpatients hourly and firing roughly twelve hours before predicted deterioration; a 2020 New England Journal of Medicine evaluation associated its alert-driven rapid-response workflow with lower mortality. Its defining feature is where the alert goes: not to the bedside, but to a dedicated regional tier of critical-care virtual quality nurse consultants who screen every alert around the clock, work up the chart, and only then escalate to the on-site rapid-response team — so the measured benefit is priced against the whole two-tier staffing topology, not the model alone.

escobar2020aGroundingPeer-reviewedSave

Escobar, G.J., Liu, V.X., Schuler, A., Lawson, B., Greene, J.D., & Kipnis, P. (2020). Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration. New England Journal of Medicine, 383(20), 1951-1960. https://doi.org/10.1056/NEJMsa2001090 https://www.nejm.org/doi/full/10.1056/NEJMsa2001090

doi.org/10.1056/NEJMsa2001090

Appears in: PAN framework development

Grounds: domain grounding: clinical decision support (sepsis/deterioration alerting, imaging triage)

thekaiserpermanentenorthernc2022GroundingAcademicSave

The Kaiser Permanente Northern California Advance Alert Monitor Program: An Automated Early Warning System for Adults at Risk for In-Hospital Clinical Deterioration (2022). Joint Commission Journal on Quality and Patient Safety. https://www.jointcommissionjournal.com/article/S1553-7250(22)00110-6/fulltext

https://www.jointcommissionjournal.com/article/S1553-7250(22)00110-6/fulltext

Appears in: PAN framework development

Grounds: domain grounding: clinical decision support (sepsis/deterioration alerting, imaging triage); model org: kaiser_aam_deterioration

Topics: ai-safety