Have machine-learning-based AKI prediction tools been implemented in clinical practice to guide vancomycin dosing or nephrotoxin stewardship?

Comment by InpharmD Researcher

Although machine-learning (ML) models developed primarily using retrospective clinical datasets demonstrate strong performance in predicting acute kidney injury (AKI) risk, evidence of the clinical implementation of ML-informed interventions and their impact on patient and provider outcomes remains limited. In a 2026 single-center implementation study, an AI-powered AKI decision-support platform was associated with a lower incidence of moderate-to-severe AKI (9.1% vs 11.7%) and reduced nephrotoxic medication use; however, the uncontrolled before-and-after design limits causal inference. The MEnD-AKI multicenter trial protocol describes an approach combining ML-based risk prediction with pharmacist-led alerts and medication-management recommendations, however, published findings on the intervention’s clinical impact were not available in the identified publication.. Overall, key gaps include limited prospective evidence, heterogeneity across study populations and clinical settings, insufficient external validation of ML models, and challenges integrating models into clinical workflows. Further controlled studies are needed to establish the effects of these approaches on AKI outcomes, nephrotoxin stewardship, and clinician workload.
Background

A 2026 review provides an extensive synthesis of artificial intelligence (AI) applications in critical care nephrology (CCN), focusing on methodologies such as machine learning (ML), deep learning (DL), reinforcement learning (RL), and generative AI models. Multimodal data integration from electronic health records (EHR), physiologic waveforms, imaging, and bedside monitoring forms the foundation for AI model development, enabling predictions of acute kidney injury (AKI), intradialytic hypotension (IDH), nephrotoxin exposure, and management of continuous kidney replacement therapy (CKRT). The review highlights that predictive ML algorithms demonstrate area under the receiver operating characteristic curve (AUROC) values ranging approximately from 0.78 to 0.97 for AKI onset and progression, yet most models lack prospective multicenter validation and real-world workflow integration. Approaches like conformal prediction enhance transparency by providing calibrated risk confidence intervals, and causal inference methods advance interpretability by estimating effects of interventions, moving beyond correlation to support actionable clinical decision-making. Reinforcement learning shows promise in adaptive, personalized fluid and dialysis management through dynamic adjustments of ultrafiltration rates based on patient-specific feedback. [1]

Generative AI and large language models (LLMs) extend AI applications to clinical documentation, reasoning, and patient education, exemplified by ambient AI scribes that reduce clinician documentation burden while introducing challenges such as hallucination—where AI outputs may be plausible but inaccurate. Mitigation strategies include retrieval-augmented generation anchored in validated clinical resources, chain-of-thought prompting to reveal reasoning steps, and domain-specific fine-tuning to improve nephrology-focused accuracy. Real-world implementations, such as AI-driven AKI alerts and CKRT alarm management tools, have shown improvements in process metrics but have yet to demonstrate significant benefits on critical patient-centered outcomes like mortality or dialysis dependence. Barriers to clinical adoption include alert fatigue, data heterogeneity, economic constraints, and limited clinician trust. The authors emphasize the necessity for rigorous external validation, clinician-centered interface design to minimize cognitive load, adaptive regulatory frameworks, and ongoing postdeployment monitoring. The review concludes that while AI holds transformative potential across risk prediction, precision nephrology, and workflow augmentation, translating technical advances into measurable clinical improvements requires multidisciplinary collaboration, ethical oversight, and sustainable integration strategies. [1]

A 2022 review examined the application of ML techniques for predicting AKI within intensive care units (ICUs). The review delineates several ML methodologies, including supervised, unsupervised, semi-supervised, and reinforcement learning, emphasizing their unique roles in AKI prediction, prognostication, and management. Supervised algorithms—such as Random Forest, Gradient Boosting Machines, Extreme Gradient Boosting (XGBoost), artificial neural networks (ANN), and recurrent neural networks like long short-term memory (LSTM)—have been trained on large critical care datasets such as Medical Information Mart for Intensive Care (MIMIC-III) and eICU to predict AKI onset up to 48 hours in advance, with reported AUROC values frequently exceeding 0.80. For instance, convolutional neural networks utilizing urine output data achieved an AUROC of 0.89 for predicting stage II and III AKI, while ensemble time-series models incorporating both explicit indicators (vital signs, labs) and implicit indicators (medication administration) improved predictive performance when medication data were included. Models predicting AKI-related adverse outcomes such as mortality and need for renal replacement therapy (RRT) leveraged algorithms like support vector machines (SVM) and random forests, demonstrating AUROCs up to 0.87 and identifying clinical variables such as urine output, systolic blood pressure, age, serum bicarbonate, and heart rate as key prognostic factors. [2]

The review also highlights efforts to refine AKI management using ML, for example, predicting fluid responsiveness in oliguric patients, where an XGBoost model achieved an AUROC of 0.86 based on features including urinary creatinine, blood urea nitrogen, albumin, and maximum temperature. Furthermore, models predicting hypotensive episodes post-continuous renal replacement therapy (CRRT) initiation demonstrated comparable performance using XGBoost and deep neural networks (AUROCs of 0.83 and 0.82, respectively), informing potential adjustments in CRRT prescription. Specialized populations such as pediatric ICU patients and surgical ICU cohorts have been the focus of tailored predictive models, achieving AUROCs around 0.80 and incorporating interpretable features to avoid "black box" limitations. Beyond prediction, ML analyses of biochemical data have underscored subphenotypes of AKI with distinct clinical outcomes and metabolomic profiles, such as reduced urinary glycine and ethanolamine levels associated with AKI. Although the review primarily focuses on predictive model development and performance, it also discusses potential ML-guided interventions, including alerting clinicians to avoid or discontinue nephrotoxic medications in high-risk patients. However, it provides limited discussion of the implementation of such approaches in clinical practice. [2]

Background References: [1] Cheungpasitporn W, Thongprayoon C, Kashani K. Artificial Intelligence in Critical Care Nephrology: Current Applications, Emerging Techniques, and Challenges to Clinical Integration. Kidney360. 2026;7(3):664-677. doi:10.34067/KID.0000001037
[2] Gottlieb ER, Samuel M, Bonventre JV, Celi LA, Mattie H. Machine Learning for Acute Kidney Injury Prediction in the Intensive Care Unit. Adv Chronic Kidney Dis. 2022;29(5):431-438. doi:10.1053/j.ackd.2022.06.005
Literature Review

A search of the published medical literature revealed 5 studies investigating the researchable question:

Have machine-learning-based AKI prediction tools been implemented in clinical practice to guide vancomycin dosing or nephrotoxin stewardship?

Level of evidence

C - Multiple studies with limitations or conflicting results  Read more→



Please see Tables 1-5 for your response.


Development and validation of machine learning models to predict vancomycin- and teicoplanin-associated acute kidney injury: A retrospective, multicenter study
Design

Retrospective, multicenter study

N= 9342

Objective To develop and validate clinically applicable prognostic machine learning models for predicting vancomycin-associated acute kidney injury (VA-AKI) and teicoplanin-associated AKI (TA-AKI)
Study Groups

Training set (n= 7020)

Internal validation set (n= 1755)

External validation set (n= 567)

Inclusion Criteria Patients receiving intravenous vancomycin or teicoplanin therapy between February 2010 and December 2020
Exclusion Criteria Individuals under 20 years old, vancomycin or teicoplanin courses lasting less than 3 days, lacking serum creatinine data within 90 days before or 7 days after the index date, baseline SCr of ≥4 mg/dL, pregnant individuals, undergoing dialysis or with multi-organ failure
Methods Utilized the Taipei Medical University Clinical Research Database. Features selected from 198 variables through recursive feature elimination using feature importance (RFECV) and SHapley Additive exPlanations importance (ShapRFECV). Twelve models constructed using XGBoost and LightGBM. Model performance assessed by eight evaluation metrics, including AUROC. SHAP analysis assisted in model interpretation
Duration February 2010 to December 2020
Outcome Measures

Primary: Predictive performance of ML models for VA-AKI and TA-AKI

Secondary: Model interpretability and clinical applicability through SHAP analysis and threshold adjustment

Results
AKI incidence Training cohort: 1,383/7,020 (19.70%); internal validation: 326/1,755 (18.58%); external validation: 116/567 (20.5%)
Model development and selection Twelve models were developed from 198 candidate features. The selected model used eXtreme Gradient Boosting (XGBoost) with feature selection based on SHapley Additive exPlanations (SHAP). It had statistically comparable performance to the model with the highest area under the precision-recall curve, while using fewer features.
Discrimination: area under the receiver operating characteristic curve Internal validation: 0.798 (95% confidence interval, 0.791–0.804); external validation: 0.779 (95% confidence interval, 0.767–0.791)
Area under the precision-recall curve Internal validation: 0.220 (95% confidence interval, 0.196–0.247); external validation: 0.242 (95% confidence interval, 0.203–0.287)
Calibration: Brier score Internal validation: 0.056; external validation: 0.072
Accuracy at different prediction thresholds Default threshold (0.500): 91.4%; equal precision/recall threshold (0.162): 87.6%; optimal F1 threshold (0.117): 84.9%
Sensitivity (recall) Default: 1.5%; equal precision/recall: 26.6%; optimal F1: 44.5%
Positive predictive value (precision) Default: 42.9%; equal precision/recall: 26.6%; optimal F1: 26.8%
Specificity Default: 99.8%; equal precision/recall: 93.3%; optimal F1: 88.7%
Negative predictive value Default: 91.6%; equal precision/recall: 93.2%; optimal F1: 94.5%
F1 score Default: 0.029; equal precision/recall: 0.266; optimal F1: 0.334
Proportion classified above the prediction threshold Default: 0.3%; equal precision/recall: 8.4%; optimal F1: 14.1%
Adverse Events Not applicable
Study Author Conclusions The XGBoost model, leveraging time-series data, accurately predicts AKI in vancomycin and teicoplanin users, supporting early risk assessment and personalized patient management. Future multicentre prospective external validation is needed to strengthen its real-world applicability and generalizability
Critique The study's retrospective design may introduce biases in data quality and completeness. The model development in a single healthcare system in Taiwan limits its generalizability to broader populations. While the model demonstrated robust predictive performance, its impact on clinical decision-making and patient outcomes has not been fully evaluated. Prospective multicentre studies are warranted to externally validate its effectiveness in diverse populations and assess its impact on clinical workflows and patient care
Table 1 References:
[3] Lo PY, Chan FY, Ku YE, Wang SY, Chen HY. Development and validation of machine learning models to predict vancomycin- and teicoplanin-associated acute kidney injury: A retrospective, multicenter study. Int J Antimicrob Agents. 2026;67(1):107651. doi:10.1016/j.ijantimicag.2025.107651

 

Impact of an Artificial Intelligence–Powered Clinical Decision Support System for Acute Kidney Injury Prevention in the Intensive Care Unit: Single-Center Uncontrolled Before-and-After Implementation Study
Design

Single-center uncontrolled before-and-after implementation study

N= 202

Objective To evaluate the association between U-Care Renal Platform (UCRP) implementation and selected ICU clinical and operational outcomes in routine practice at SCIAS Hospital, Barcelona
Study Groups

Preimplementation (n= 103)

Postimplementation (n= 99)

Inclusion Criteria Postsurgical adult ICU patients admitted between March 2023 and March 2025
Exclusion Criteria Lacked age or gender information; had AKI stage 2 or 3 within the first 24 hours of ICU admission
Methods

Retrospective service evaluation comparing preimplementation and postimplementation periods. UCRP integrated with ICU EHR to predict AKI risk and provide guideline-based recommendations. Data extracted from ICCA database. Excluded months when UCRP was inactive. Outcomes included AKI incidence, nephrotoxic medication use, hypotensive episodes, and ICU length of stay

The UCRP consists of 3 modules:

  • STAGING module: In accordance with international KDIGO guidelines, the AKI stage (0‐3) is determined hourly during hospitalization for each patient admitted to the ICU by analyzing urine output and creatinine data.
  • AKIRA module: Based on the proprietary AKIRA machine learning algorithm, the system predicts the onset of a moderate or severe AKI episode (stage 2 or 3) within the next 24 hours in patients identi fied as stage 0 or 1 using the STAGING module. During the ICU stay, AKIRA analyzes the patient’s clinical data, including laboratory tests, physiological parameters, and demographics, on an hourly basis to calculate a personalized risk index for the development of moderate or severe AKI.
  • KDIGO bundle module: This module supports ICU clinicians in managing patients at risk for AKI in accordance with international KDIGO guidelines. Specifically, it allows for automatic monitoring of prescribed nephrotoxic medications, with notification of potentially harmful active ingredients requiring discontinuation or reassessment; automatic monitoring of nephrotoxic drug dosages, with timely recommen dations for adjustments based on current glomerular filtration rate values; and automatic monitoring of hypotension and hyperglycemia events, with timely alerts for proactive clinical management.

Drugs that were considered nephrotoxic included aminoglycosides (eg, amikacin, gentamicin), vancomycin, nonsteroidal anti-inflammatory drugs (eg, dexketoprofen, metamizole, acetylsalicylic acid, diclofenac), β-lactam antibiotics (eg, amoxicillin-clavulanate, ceftriaxone, cefazolin, ceftazidime, piperacillin-tazobactam, ampicillin, penicillin G), fluoroquinolones (eg, ciprofloxacin, levofloxacin), antiviral agents (eg, intravenous acyclovir), angiotensin-converting enzyme inhibitors (eg, captopril, enalapril), angiotensin II receptor blockers (eg, losartan, valsartan), diuretics (eg, furosemide, hydrochlorothiazide, mannitol), and trimethoprim-sulfamethoxazole.

The platform continuously monitored patient data and generated alerts for predefined or clinically significant criteria, including AKI risk (AKIRA index) and KDIGO-based recommendations for hypotension, hyperglycemia, and nephrotoxic drug exposure. Thus, overall alert activity reflected a broad range of integrated clinical monitoring signals rather than a single event-specific alert.

Duration March 2023 to March 2025
Outcome Measures

Primary: Incidence of moderate-to-severe AKI (KDIGO stages 2 and 3)

Secondary: Use of nephrotoxic medications, frequency of hypotensive episodes, ICU length of stay

Baseline Characteristics   Preimplementation (n=103) Postimplementation (n=99)
Male, n/N (%) 51/103 (50) 51/99 (51)
Age (y), median (IQR) 71 (63-77) 74 (65-80)
Baseline serum creatinine (mg/dL), median (IQR) 0.90 (0.76-0.98) 0.95 (0.75-0.98)
ICU length of stay (h), median (IQR) 22.2 (18.4-57.3) 23.8 (17.8-42.7)
Results   Preimplementation (n=103) Postimplementation (n=99)
Incidence of stage 2 and 3 AKI 12/103 (11.7%) 9/99 (9.1%)
Nephrotoxic drug administrations, median (IQR)  9 (4-16) 6.5 (3-10)
Patients with hypotension episodes 11/29 (37.9%) 9/34 (26.5%)
ICU length of stay (h), median (IQR) 22.2 (18.4‐57.3) 23.8 (17.8‐42.7)
Study Author Conclusions Integration of the UCRP into ICU workflows was associated with differences in selected AKI-related process and intermediate clinical outcomes. However, causal relationships cannot be established, and findings should be interpreted as preliminary signals requiring confirmation in larger, controlled, and multicenter studies. 
Critique The study provides preliminary insights into the potential benefits of AI-powered clinical decision support systems in ICU settings. However, the uncontrolled before-and-after design limits causal inference, and the small sample size may affect the generalizability of the findings. The study's reliance on retrospective data and the potential for sponsor-related bias due to the authors' affiliations with the system's manufacturer are additional limitations. Future research should include larger, multicenter, and controlled studies to validate these findings and explore patient-centered outcomes. 
Table 2 References:
[4] Alfieri F, Ancona A, Bacci A, Zappal S, Perez JM. Impact of an Artificial Intelligence-Powered Clinical Decision Support System for Acute Kidney Injury Prevention in the Intensive Care Unit: Single-Center Uncontrolled Before-and-After Implementation Study. JMIR Form Res. 2026;10:e87738. Published 2026 Jul 8. doi:10.2196/87738
Development of a machine learning-based prediction model for acute kidney injury associated with respiratory failure in the intensive care unit
Design

Retrospective cohort study

N= 10,780

Objective To develop and validate an early AKI prediction model using machine learning for ICU patients with respiratory failure
Study Groups

AKI (n= 5,819)

Non-AKI (n= 4,961)

Inclusion Criteria Patients diagnosed with ICD-10-CM J96 respiratory failure (not elsewhere classified) and individuals diagnosed with AKI
Exclusion Criteria Patients under 18 years of age, patients with multiple ICU admissions, patients with an ICU stay of less than 48 hours, and patients with incomplete AKI data
Methods Data from the MIMIC-IV database were used. Ten supervised learning algorithms were trained using predictors from the first 48 hours of ICU admission. Recursive feature elimination was used to select the top 15 features for each model. SHAP analysis was used for feature importance interpretation.
Duration Data from 2008 to 2019
Outcome Measures

Primary: Comparative predictive performance of the machine-learning algorithms

Baseline Characteristics   Non-AKI (n= 4,961) AKI (n= 5,819)

Age, median (Q1-Q3), years

65.39 (54.14-76.23) 69.58 (58.32-79.75)
Length of hospital stay, median (Q1-Q3), days 11.39 (7.03-19.22) 14.27 (8.33-23.88)

Length of ICU stay, median (Q1-Q3), days

5.21 (3.30-9.73) 6.17 (3.60-11.45)
BMI, median (Q1-Q3) 26.87 (23.06-32.08) 28.75 (24.42-34.40)
Charlson comorbidity index, median (Q1-Q3) 5.00 (3.00-7.00) 6.00 (4.00-8.00)
Heart rate mean, median (Q1-Q3), bpm 85.64 (74.83-98.10) 88.17 (75.73-101.31)
Systolic blood pressure mean, median (Q1-Q3) 115.08 (106.17-126.70) 111.22 (103.56-122.05)
Diastolic blood pressure mean, median (Q1-Q3) 63.11 (57.04-70.50) 60.46 (54.31-67.17)
Respiratory rate mean, median (Q1-Q3) 19.72 (17.26-22.50) 20.73 (18.04-23.91)
Temperature mean, median (Q1-Q3) 36.98 (36.70-37.35) 36.86 (36.58-37.24)
SOFA score, median (Q1-Q3) 5.00 (3.00-7.00) 8.00 (5.00-11.00)
Glasgow Coma Scale, median (Q1-Q3) 15.00 (14.00-15.00) 15.00 (13.00-15.00)
Lactate max, median (Q1-Q3) 1.80 (1.20-2.90) 2.40 (1.50-4.40)
Creatinine max, median (Q1-Q3) 0.90 (0.70-1.10) 1.80 (1.30-2.70)
BUN max, median (Q1-Q3) 18.00 (13.00-26.00) 36.00 (24.00-57.00)
Urine output, median (Q1-Q3) 1,580.00 (1,005.00-2,452.00) 1,195.00 (635.00-2,035.00)
Results   Area under the receiver operating characteris-
tic curve (AUC)
Accuracy Sensitivity Specificity Precision NPV F1-score Brier score
XGBoost 0.9023 0.8247 0.8077 0.8386 0.8038 0.8419 0.8058 0.1248
AdaBoost 0.8966 0.8173 0.8036 0.8285 0.7932 0.8374 0.7984 0.1307
ElasticNet 0.8941 0.7663 0.7696 0.7635 0.7351 0.7953 0.7520 0.1597
LGBM 0.8953 0.8228 0.8145 0.8298 0.8032 0.8399 0.8088 0.1278
LogisticRegression 0.8436 0.7606 0.7937 0.7324 0.7166 0.8063 0.7532 0.1619
MLP 0.8837 0.8145 0.8111 0.8172 0.7842 0.8409 0.7974 0.1355
NB 0.8686 0.7917 0.8400 0.7521 0.7350 0.8517 0.7840 0.1801
NN 0.8837 0.8145 0.8111 0.8172 0.7842 0.8409 0.7974 0.1355
RF 0.8917 0.8225 0.8179 0.8264 0.8007 0.8418 0.8092 0.1304
SVM 0.8820 0.8095 0.8166 0.8037 0.7731 0.8426 0.7943 0.1372

XGBoost performed best, with an AUC of 0.9023, indicating strong ability to discriminate between patients with and without recorded AKI.

Among the 4,961 patients without AKI at initial assessment, XGBoost identified 796 (16.0%) as high risk for subsequent AKI.

Adverse Events Not applicable
Study Author Conclusions The XGBoost-based model demonstrated superior predictive performance for AKI in ICU patients with respiratory failure, enabling early risk identification and potential for timely interventions. The model's integration into clinical workflows could improve patient outcomes by facilitating proactive AKI management.
Critique The study was limited by its retrospective, single-center design, potential selection bias, and lack of external validation. Although the authors discussed using high-risk predictions to inform preventive interventions, including reducing nephrotoxic medication exposure and optimizing fluid and hemodynamic management, the implementation and clinical impact of these interventions were not evaluated.

 

Table 3 References:
[5] Qin H, Wu Q, Tan J, et al. Development of a machine learning-based prediction model for acute kidney injury associated with respiratory failure in the intensive care unit. Clin Exp Med. 2025;25(1):326. Published 2025 Oct 25. doi:10.1007/s10238-025-01873-y

Multi-hospital electronic decision support for drug-associated acute kidney injury (MEnD-AKI): Study protocol for a randomized clinical trial
Design

Prospective, multi-site, cluster-randomized clinical trial protocol

N= 3000

Objective To examine the effect of a pharmacist-led intervention augmented with predictive analytics in the form of electronic alerts delivered to pharmacists followed by drug management recommendations provided to physicians for the early management of patients at risk of developing AKI or progressing to higher AKI stages
Study Groups

Intervention group (n= 19 hospital-service clusters)

Control group (n= 19 hospital-service clusters)

Inclusion Criteria All attending physicians at the study sites that belong to a primary service, excluding critical care, emergency medicine, transplant, and physician consult services
Exclusion Criteria Physicians who opt-out of the study
Methods

Usual care consists of a passive electronic medical record alert identifying and staging AKI, without specific management recommendations. The intervention combines near-real-time electronic patient data, automated AKI staging, and a neural network model predicting progression to stage 2 or 3 AKI within 48 hours. The system also identifies nephrotoxic medications and renally eliminated drugs administered within the preceding 24 hours, then sends qualifying alerts to pharmacy personnel through a web application.

The intervention consists of two levels. Level A applies to patients with stage 1 AKI who are receiving a nephrotoxin but have a low predicted risk of progression; pharmacy personnel provide general guideline-based recommendations by the next operational business day. Level B applies to patients without AKI or with stage 1 AKI who are receiving a nephrotoxin and have a high predicted risk of progression, or patients already at stage 2 or 3 AKI who are receiving a nephrotoxin or a renally eliminated drug potentially requiring dose adjustment. After screening alerts for eligibility, redundancy, and actionability, a pharmacist reviews the chart and contacts the physician via telemedicine, with a target response within 12 hours. Recommendations may include discontinuing or substituting nephrotoxins, adjusting doses or dosing intervals, ordering kidney function or other laboratory monitoring, recommending hydration, modifying home medications, or taking no action. Physicians retain final treatment authority, and pharmacists document recommendations and acceptance. Outcomes are assessed at the patient level, with blinded statistical analysis

 

Duration Not specified
Outcome Measures

Primary: Major adverse kidney events (MAKE) within 30 days of admission

Secondary: Progression of AKI, AKI duration, nephrotoxic burden

Results
Endpoint Timeframe Description
Primary: Major adverse kidney events within 30 days of randomization (MAKE30) Up to 30 days Composite of death, new kidney replacement therapy, or final serum creatinine ≥150% of reference at hospital discharge or 30 days from study enrollment, whichever occurs first.
Secondary: Progression of acute kidney injury (AKI) from Level B intervention (first alert generated) to hospital discharge Up to 30 days Percentage of high-risk patients without AKI at the first Level B alert who subsequently progress to maximum AKI severity stage 1, 2, or 3; percentage with stage 1 AKI at a Level B alert who subsequently progress to maximum severity stage 2 or 3; and percentage with stage 2 AKI at a Level B alert who subsequently progress to maximum severity stage 3. Each is assessed before hospital discharge or 30 days, whichever occurs first.
Secondary: AKI intensity: duration of AKI across all stages; duration of stage 2 AKI; duration of stage 3 AKI Up to 30 days AKI intensity rate per 100 exposed patient-days, calculated as the number of days patients have AKI divided by the total number of AKI-exposed patient-days, standardized per 100 exposed days.
Secondary: Nephrotoxic burden Up to 30 days Drug-days in both study arms for drugs considered possible/probable, probable, or definitely related to AKI in adult patients outside the intensive care unit. Each drug and each day of therapy increases the burden by 1 drug-day.
Adverse Events N/A
Study Author Conclusions Clinical decision support driven by AI delivered to physicians in the form of automated alerts and pharmacist guidance could dramatically improve risk assessment, medication use, and drug dosing in patients with or at risk of developing AKI
Critique The study is innovative in its use of AI-driven CDSS and pharmacist-led interventions, which could significantly improve patient outcomes. However, the reliance on existing UPMC infrastructure and services may limit generalizability to other health systems without similar resources. The study's design as a cluster-randomized trial is a strength, but the lack of detailed baseline characteristics and results in the protocol limits the ability to fully assess potential biases and outcomes.
Table 4 References:
[6] Stottlemyer BA, Kellum JA, Bihorac A, et al. Multi-hospital electronic decision support for drug-associated acute kidney injury (MEnD-AKI): Study protocol for a randomized clinical trial. Contemp Clin Trials. 2025;157:108055. doi:10.1016/j.cct.2025.108055

Predicting Nephrotoxic Acute Kidney Injury in Hospitalized Adults: A Machine Learning Algorithm
Design

Retrospective cohort study

N= 14,480

Objective To use machine learning to update the nephrotoxic injury negated by just-in time action (NINJA) program to improve accuracy in predicting nephrotoxic acute kidney injury (AKI) among adults
Study Groups All patients (N= 14,480)
Inclusion Criteria Adults admitted for > 48 hours to the University of Iowa Hospital from 2017 to 2022 with at least one patient-day of high-nephrotoxin exposure
Exclusion Criteria Admissions < 48 hours; baseline estimated glomerular filtration < 15 mL/min/1.73m2 or on long-term dialysis; AKI at admission; < 2 creatinine values during admission; absence of laboratory testing or vital sign data
Methods A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data and tested on 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. An artificial neural network was used to determine risk factor importance
Duration 2017 to 2022
Outcome Measures Primary: AKI within 48 hours of high-nephrotoxin exposure Secondary: AKI within 72 hours of high-nephrotoxin exposure
Baseline Characteristics   High-Nephrotoxin Exposure (n = 18,180)
Age, y, median (IQR) 61 (49-70)
Female sex 7,861 (43.3%)
Caucasian race 16,330 (89.9%)
Body mass index, median (IQR) 28 (24-34)
Chronic pulmonary disease 2,920 (16.1%)
Diabetes mellitus 2,666 (14.7%)
Congestive heart failure 2,075 (11.4%)
Cerebrovascular disease 2,063 (11.4%)
Peripheral vascular disease 1,366 (7.5%)
Cirrhotic liver disease 1,227 (6.8%)
Myocardial infarction 784 (4.3%)
ICU admission 4,522 (24.9%)
Length of stay, d, and median (IQR) 9 (5-16)
In-hospital mortality 5,563 (30.6%)
Results   NINJA RNN-GRU (48 h) RNN-GRU (72 h)
Positive predictive value 0.29 0.60 (0.58-0.62) 0.57 (0.55-0.58)
Negative predictive value N/A 0.85 (0.84-0.86) 0.85 (0.84-0.86)
Recall 1.0 0.65 (0.63-0.67) 0.72 (0.70-0.74)
F1-statistic 0.29 0.78 (0.77-0.79) 0.74 (0.72-0.75)
Area under the curve N/A 0.82 (0.81-0.83) 0.81 (0.79-0.82)
Sensitivity 100% 65% (62%-67%) 72% (70%-74%)
Specificity N/A 83% (82%-84%) 74% (73%-76%)
Positive likelihood ratio N/A 3.8 (3.5-4.1) 2.8 (2.6-3.0)
Negative likelihood ratio N/A 0.43 (0.40-0.46) 0.38 (0.35-0.41)
False alerts per AKI 2.45 0.66 (0.61-0.72) 0.75 (0.72-0.82)
Adverse Events N/A
Study Author Conclusions The RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.
Critique The study effectively demonstrates the potential of machine learning to improve AKI prediction accuracy and reduce false alerts, which is a significant advancement for adult populations. However, the study's limitations include the lack of exhaustive clinical variables and medication data, and the potential lack of generalizability due to the racial makeup of the Iowa population. Additionally, the model's black-box nature limits understanding of the decision-making process.
Table 5 References:
[7] Griffin BR, Mudireddy A, Horne BD, et al. Predicting Nephrotoxic Acute Kidney Injury in Hospitalized Adults: A Machine Learning Algorithm. Kidney Med. 2024;6(12):100918. Published 2024 Oct 15. doi:10.1016/j.xkme.2024.100918