AI-Based Risk Model Leverages Mammograms for Personalized Breast Cancer Screening

By MedImaging International staff writers
Posted on 21 Jan 2022

Illustration

A new technology for creating risk-based screening guidelines use machine learning to provide personalized breast cancer screening.

Tempo, developed by scientists from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and Jameel Clinic for Machine Learning and Health (Cambridge MA, USA), uses an AI-based risk model that looks at who was screened and when they got diagnosed to recommend a patient return for a mammogram at a specific time point in the future, like six months or three years. The same Tempo policy can be easily adapted to a wide range of possible screening preferences, which would let clinicians pick their desired early detection to screening cost trade-off, without training new policies.

While mammograms are currently the gold standard in breast cancer screening, swirls of controversy exist: advocates argue for the ability to save lives, (women 60-69 had a 33% lower risk of dying compared to those who didn’t get mammograms), and another camp argues about costly and potentially traumatic false positives (a meta-analysis of three randomized trials found a 19% over-diagnosis rate from mammography). Even with some saved lives, and some overtreatment and overscreening, current guidelines are still a catch all: women aged 45 to 54 should get mammograms every year. While personalized screening has long been thought of as the answer, tools that can leverage the troves of data to do this lag behind.

Early uses of AI in medicine stem back to the 1960’s, where many refer to the Dendral experiments as kicking off the field. Researchers created a software system that was considered the first expert kind that automated the decision-making and problem-solving behavior of organic chemists. Sixty years later, deep medicine has greatly evolved drug diagnostics, predictive medicine, and patient care.

Tempo uses reinforcement learning, a machine learning method widely known for success in games like Chess and Go, to develop a “policy” that predicts a follow-up recommendation for each patient. The training data here only had information about a patient’s risk at the time points when their mammogram was taken (when they were 50, or 55, for example). The team needed the risk assessment at intermediate points, so they designed their algorithm to learn a patient’s risk at unobserved time points from their observed screenings, which evolved as new mammograms of the patient became available.

The team first trained a neural network to predict future risk assessments given previous ones. This model then estimates patient risk at unobserved time points, and it enables simulation of the risk-based screening policies. Next, they trained that policy, (also a neural network), to maximize the reward (for example, the combination of early detection and screening cost) to the retrospective training set. Eventually, you’d get a recommendation for when to return for the next screen, ranging from six months to three years in the future, in multiples of six months – the standard is only one or two years.

Let’s say patient A comes in for their first mammogram, and eventually gets diagnosed at year four. In year two, there’s nothing, so they don’t come back for another two years, but then at year four they get a diagnosis. Now there's been two years of gap between the last screen, where a tumor could have grown. Using Tempo, at that first mammogram, year zero, the recommendation might have been to come back in two years. And then at year two, it might have seen that risk is high, and recommended that the patient come back in six months, and in the best case, it would be detectable. The model is dynamically changing the patient’s screening frequency, based on how the risk profile is changing.

Tempo uses a simple metric for early detection, which assumes that cancer can be caught up to 18 months in advance. While Tempo outperformed current guidelines across different settings of this assumption (six months, twelve months), none of these assumptions are perfect as the early detection potential of a tumor depends on that tumor's characteristics. The team suggested that follow up work using tumor growth models could address this issue. Also, the screening cost metric, which counts the total screening volume recommended by Tempo, doesn't provide a full analysis of the entire future cost because it does not explicitly quantify false positive risks or additional screening harms.

There are many future directions that can further improve personalized screening algorithms. The team says one avenue would be to build on the metrics used to estimate early detection and screening costs from retrospective data, which would result in more refined guidelines. Tempo could also be adapted to include different types of screening recommendations, such as leveraging MRI or mammograms, and future work could separately model the costs and benefits of each. With better screening policies, recalculating the earliest and latest age that screening is still cost-effective for a patient might be feasible.

“By tailoring the screening to the patient's individual risk, we can improve patient outcomes, reduce over treatment and eliminate health disparities,” said Adam Yala, MIT CSAIL PhD student and lead researcher. Given the massive scale of breast cancer screening, with tens of millions of women getting mammograms every year, improvements to our guidelines are immensely important.”

“Current guidelines divide the population into a few large groups, like younger or older than 55, and recommend the same screening frequency to all the members of a cohort. The development of AI based risk models that operate over raw patient data give us an opportunity to transform screening, giving more frequent screens to those who need it and sparing the rest,” added Yala. “A key aspect of these models is that their predictions can evolve over time as a patient’s raw data changes, suggesting that screening policies need to be attuned to changes in risk and be optimized over long periods of patient data.”

Related Links:
CSAIL