tetano
Editor, Senior Moderator
JAMA Health Forum
. 2024 Sep 6;5(9):e242884.
doi: 10.1001/jamahealthforum.2024.2884. A Machine Learning Method for Allocating Scarce COVID-19 Monoclonal Antibodies
Mengli Xiao[SUP] 1 [/SUP], Kyle C Molina[SUP] 2 [/SUP], Neil R Aggarwal[SUP] 3 [/SUP], Laurel E Beaty[SUP] 1 [/SUP], Tellen D Bennett[SUP] 4 5 6 [/SUP], Nichole E Carlson[SUP] 1 [/SUP], Lindsey E Fish[SUP] 7 8 [/SUP], Mika K Hamer[SUP] 9 [/SUP], Bethany M Kwan[SUP] 2 5 10 [/SUP], David A Mayer[SUP] 1 5 [/SUP], Jennifer L Peers[SUP] 2 [/SUP], Matthew K Wynia[SUP] 9 [/SUP], Adit A Ginde[SUP] 2 [/SUP]
Affiliations
Importance: During the COVID-19 pandemic, the effective distribution of limited treatments became a crucial policy goal. Yet, limited research exists using electronic health record data and machine learning techniques, such as policy learning trees (PLTs), to optimize the distribution of scarce therapeutics.
Objective: To evaluate whether a machine learning PLT-based method of scarce resource allocation optimizes the treatment benefit of COVID-19 neutralizing monoclonal antibodies (mAbs) during periods of resource constraint.
Design, setting, and participants: This retrospective cohort study used electronic health record data from October 1, 2021, to December 11, 2021, for the training cohort and data from June 1, 2021, to October 1, 2021, for the testing cohort. The cohorts included patients who had positive test results for SARS-CoV-2 and qualified for COVID-19 mAb therapy based on the US Food and Drug Administration's emergency use authorization criteria, ascertained from the patient electronic health record. Only some of the qualifying candidates received treatment with mAbs. Data were analyzed between from January 2023 to May 2024.
Main outcomes and measures: The primary outcome was overall expected hospitalization, assessed as the potential reduction in overall expected hospitalization if the PLT-based allocation system was used. This was compared to observed allocation using risk differences.
Results: Among 9542 eligible patients in the training cohort (5418 female [56.8%]; age distribution: 18-44 years, 4151 [43.5%]; 45-64 years, 3146 [33.0%]; and ≥65 years, 2245 [23.5%]), a total of 3862 (40.5%) received mAbs. Among 6248 eligible patients in the testing cohort (3416 female [54.7%]; age distribution: 18-44 years, 2827 [45.2%]; 45-64 years, 1927 [30.8%]; and ≥65 years, 1494 [23.9%]), a total of 1329 (21.3%) received mAbs. Treatment allocation using the trained PLT model led to an estimated 1.6% reduction (95% CI, -2.0% to -1.2%) in overall expected hospitalization compared to observed treatment allocation in the testing cohort. The visual assessment showed that the PLT-based point system had a larger reduction in 28-day hospitalization compared with the Monoclonal Antibody Screening Score (maximum overall hospitalization difference, -1.0% [95% CI, -1.3% to -0.7%]) in the testing cohort.
Conclusions and relevance: This retrospective cohort study proposes and tests a PLT method, which can be linked to a electronic health record data platform to improve real-time allocation of scarce treatments. Use of this PLT-based allocation method would have likely resulted in fewer hospitalizations across a population than were observed in usual care, with greater expected reductions than a commonly used point system.
. 2024 Sep 6;5(9):e242884.
doi: 10.1001/jamahealthforum.2024.2884. A Machine Learning Method for Allocating Scarce COVID-19 Monoclonal Antibodies
Mengli Xiao[SUP] 1 [/SUP], Kyle C Molina[SUP] 2 [/SUP], Neil R Aggarwal[SUP] 3 [/SUP], Laurel E Beaty[SUP] 1 [/SUP], Tellen D Bennett[SUP] 4 5 6 [/SUP], Nichole E Carlson[SUP] 1 [/SUP], Lindsey E Fish[SUP] 7 8 [/SUP], Mika K Hamer[SUP] 9 [/SUP], Bethany M Kwan[SUP] 2 5 10 [/SUP], David A Mayer[SUP] 1 5 [/SUP], Jennifer L Peers[SUP] 2 [/SUP], Matthew K Wynia[SUP] 9 [/SUP], Adit A Ginde[SUP] 2 [/SUP]
Affiliations
- PMID: 39269694
- PMCID: PMC11400220
- DOI: 10.1001/jamahealthforum.2024.2884
Importance: During the COVID-19 pandemic, the effective distribution of limited treatments became a crucial policy goal. Yet, limited research exists using electronic health record data and machine learning techniques, such as policy learning trees (PLTs), to optimize the distribution of scarce therapeutics.
Objective: To evaluate whether a machine learning PLT-based method of scarce resource allocation optimizes the treatment benefit of COVID-19 neutralizing monoclonal antibodies (mAbs) during periods of resource constraint.
Design, setting, and participants: This retrospective cohort study used electronic health record data from October 1, 2021, to December 11, 2021, for the training cohort and data from June 1, 2021, to October 1, 2021, for the testing cohort. The cohorts included patients who had positive test results for SARS-CoV-2 and qualified for COVID-19 mAb therapy based on the US Food and Drug Administration's emergency use authorization criteria, ascertained from the patient electronic health record. Only some of the qualifying candidates received treatment with mAbs. Data were analyzed between from January 2023 to May 2024.
Main outcomes and measures: The primary outcome was overall expected hospitalization, assessed as the potential reduction in overall expected hospitalization if the PLT-based allocation system was used. This was compared to observed allocation using risk differences.
Results: Among 9542 eligible patients in the training cohort (5418 female [56.8%]; age distribution: 18-44 years, 4151 [43.5%]; 45-64 years, 3146 [33.0%]; and ≥65 years, 2245 [23.5%]), a total of 3862 (40.5%) received mAbs. Among 6248 eligible patients in the testing cohort (3416 female [54.7%]; age distribution: 18-44 years, 2827 [45.2%]; 45-64 years, 1927 [30.8%]; and ≥65 years, 1494 [23.9%]), a total of 1329 (21.3%) received mAbs. Treatment allocation using the trained PLT model led to an estimated 1.6% reduction (95% CI, -2.0% to -1.2%) in overall expected hospitalization compared to observed treatment allocation in the testing cohort. The visual assessment showed that the PLT-based point system had a larger reduction in 28-day hospitalization compared with the Monoclonal Antibody Screening Score (maximum overall hospitalization difference, -1.0% [95% CI, -1.3% to -0.7%]) in the testing cohort.
Conclusions and relevance: This retrospective cohort study proposes and tests a PLT method, which can be linked to a electronic health record data platform to improve real-time allocation of scarce treatments. Use of this PLT-based allocation method would have likely resulted in fewer hospitalizations across a population than were observed in usual care, with greater expected reductions than a commonly used point system.