Skip to main content
glasses-and-computer-screen

Insights

Medical Research April 05, 2018

Improving patient safety with bedside computer vision

By Erin Digitale

Can computers carry out hospital safety-monitoring tasks better than humans? A Stanford research team has been testing the idea; so far, it's working well.

Medical errors at the bedside continue to harm many patients across the U.S., although nearly two decades have passed since the Institute of Medicine's 1999 report on preventable patient harm first raised the issue. Doctors and nurses are human after all: They strive for - but rarely achieve - perfect care.

But what if clinician imperfection could be neutralized by a form of artificial intelligence that continuously detects, and prompts correction of, defects in bedside care? That's the proposition that a Stanford research team from the engineering and medical schools explains in a perspective piece published in the New England Journal of Medicine. They've been using imaging sensors at hospital room doorways and neural network technology to create an algorithm to detect hospital staff use and non-use of hand sanitizers, an important driver of patient safety.

The work began at Lucile Packard Children's Hospital and Intermountain's LDS Hospital, via research teams launched by Stanford's Arnold Milstein, MD, and Fei Fei Li, PhD, and supported by clinicians and electrical engineering students including PhD student and first author Serena Yeung.

To protect patient and staff privacy, the team used depth and thermal sensors to create images of human shapes in motion without revealing their identity. The sensors were mounted in the doorways of patient rooms adjacent to hand hygiene alcohol gel dispensers. The researchers exposed a neural network layer to labelled images that showed people using and failing to use a wall-mounted alcohol gel dispenser. The initial algorithm distinguishes between use and non-use of proper hand hygiene at greater than 95 percent accuracy.

"Essentially, these types of machine learning-based approaches offer us the potential to learn at scale, from large amounts of data," Yeung told me. "We intend to detect actions such as hand hygiene and monitor them 24/7 across entire hospitals at very low cost."

The researchers are gathering clinician advice on how to best convey real-time alerts. They write:

Such systems could remind a doctor or nurse to perform hand hygiene if they begin to enter a patient room without doing so, alert a surgeon that an important step has been missed during a complex procedure, or notify a nurse that an agitated patient is dangerously close to pulling out an endotracheal tube. The use of computer vision to continuously monitor bedside behavior could offload low-value work better suited to machines, augmenting rather than replacing clinicians.

Milstein, a professor of medicine and senior author on the research, noted that "bedside computer vision will bring us much closer to clinicians' multi-century unfulfilled aspiration to 'do no harm.'"

Photo by Kevin

About Stanford Medicine

Stanford Medicine is an integrated academic health system comprising the Stanford School of Medicine and adult and pediatric health care delivery systems. Together, they harness the full potential of biomedicine through collaborative research, education and clinical care for patients. For more information, please visit med.stanford.edu.

Erin-Digitale-headshot-July-2015

Senior science writer

Erin Digitale

Erin Digitale, PhD, is a senior science writer in the Office of Communications. She earned a bachelor’s of science in biochemistry from the University of British Columbia and a doctorate in nutrition from the University of California, Davis, where she helped develop a new animal model of Type 2 diabetes. She holds a certificate in science writing from UC Santa Cruz and writes for the Stanford Medicine about pediatrics, obstetrics and gynecology, nutrition, and children’s health policy. Erin’s writing has been recognized with several national-level awards from the Association of American Medical Colleges and the Council for the Advancement and Support of Education. When she isn’t settling down at her desk with a pile of scientific studies and a large cup of tea, you can find her swimming, experimenting in the kitchen or going on hikes with her kids.