The Data Science team at Stanford Health Care has developed a mechanism to identify fair, useful and reliable AI models (FURM) by conducting an ethical review to identify potential value mismatches, simulations to estimate usefulness, financial projections to assess sustainability, as well as analyses to determine IT feasibility, design a deployment strategy, and recommend a prospective monitoring and evaluation plan.
The FURM assessment uses APLUS, a reusable framework for quantitatively assessing via simulation the utility gained from integrating a model into a clinical workflow. Click here to learn more about APLUS.