Medical device safety in the real world: Tapping EHR data

Researchers used artificial intelligence and de-identified data from electronic health records to identify the safest types of hip implants.

- By Hanae Armitage

Nigam Shah

Before any medical device, such as a pacemakers or artificial hip implant, reaches the market, it has to meet certain safety standards set by the Food and Drug Administration. But these standards are just a first step; any number of things can happen when the devices hit the clinic. 

“The safety standards required by the FDA are for initial approval of the device’s use,” said Nigam Shah, PhD, associate professor of medicine and biomedical data science at Stanford. “What we need is a scalable way — beyond self-reporting — to see how safe and effective these devices are in a population after years of use.”

Large numbers of health records detailing the experiences of real-world patients hold the answer, Shah said. And he and his team are using artificial intelligence to mine them.

paper detailing the findings of the study was published online Sept. 25 in npj Digital Medicine. Shah is the senior author. Stanford research scientists Alison Callahan, PhD, and Jason Fries, PhD, share lead authorship.

There are other obstacles. Patient information is often spread across multiple databases, making it difficult to detect any signal of a given device’s safety profile or success rates. Shah and his team’s AI-based monitoring method gets around that by accessing patient data stripped of personal identifying information.

‘Wealth of information’

“There’s a wealth of information hidden in these records, and collected by the millions, they provide a valuable resource to show which devices are the most dependable,” Fries said.

The idea behind the algorithm is to find a way to link up certain medical characteristics — things like infection rates, how long an implant lasts before it needs to be replaced, and levels of patient pain — with specific implantable devices. Shah and his team chose to follow hip implants as a proof of principle, since they’re one of the most common medical devices.

The team showed that the algorithm accurately and efficiently identified complication events with each patient’s implant. Callahan explained that the algorithm also pointed to a powerful predictor of complication: pain.

“Previous studies have likewise shown that pain is a useful predictor for more serious complications later on,” she said. By tracking patient pain levels over time, the model helped reveal a patient’s quality of life with that specific implant. By compiling data from many patients, the algorithm also provided a broader picture of complications and pain levels associated with each device.

The researchers know the algorithm can flag the safest devices. But Fries and Callahan hope it could provide even more nuanced information. For instance, people are getting hip implants at younger ages, Callahan said, and will have them for longer periods of time. Ideally, the algorithm could help show which implant models are best for specific populations — say, for someone in their 40s versus someone in their 70s.

“The vision is to use this technology to provide tailored, patient-level recommendations based on a person’s medical history,” Fries said. But for that, the researchers need more data, so they’re beginning to deploy the model at other sites, such as in the Veterans Affairs Health Administration, to see how it fairs.

“Our hope is that as we incorporate new data, we will continue to improve our model’s accuracy and efficiency while increasing the utility among a broad population of patients,” Callahan said.

The research was supported by the National Institutes of Health.


About Stanford Medicine

Stanford Medicine is an integrated academic health system comprising the Stanford School of Medicine and adult and pediatric health care delivery systems. Together, they harness the full potential of biomedicine through collaborative research, education and clinical care for patients. For more information, please visit

2024 ISSUE 1

Psychiatry’s new frontiers