Final model performance for clinician- and patient-reported 6-month treatment response
. | AUC . | Cut-point∗ . | Sensitivity . | Specificity . | PPV . | NPV . |
---|---|---|---|---|---|---|
Clinician model | ||||||
Training | 0.83 | 0.47 | 0.77 | 0.79 | 0.75 | 0.80 |
Validation | 0.75 | 0.47 | 0.60 | 0.79 | 0.77 | 0.63 |
Patient model | ||||||
Cut-point based on Youden J | ||||||
Training | 0.86 | 0.63 | 0.75 | 0.86 | 0.86 | 0.74 |
Validation | 0.75 | 0.63 | 0.52 | 0.84 | 0.85 | 0.50 |
Cut-point based on distance to (1, 1) | ||||||
Training | 0.86 | 0.54 | 0.78 | 0.82 | 0.84 | 0.76 |
Validation | 0.75 | 0.54 | 0.60 | 0.78 | 0.83 | 0.53 |
. | AUC . | Cut-point∗ . | Sensitivity . | Specificity . | PPV . | NPV . |
---|---|---|---|---|---|---|
Clinician model | ||||||
Training | 0.83 | 0.47 | 0.77 | 0.79 | 0.75 | 0.80 |
Validation | 0.75 | 0.47 | 0.60 | 0.79 | 0.77 | 0.63 |
Patient model | ||||||
Cut-point based on Youden J | ||||||
Training | 0.86 | 0.63 | 0.75 | 0.86 | 0.86 | 0.74 |
Validation | 0.75 | 0.63 | 0.52 | 0.84 | 0.85 | 0.50 |
Cut-point based on distance to (1, 1) | ||||||
Training | 0.86 | 0.54 | 0.78 | 0.82 | 0.84 | 0.76 |
Validation | 0.75 | 0.54 | 0.60 | 0.78 | 0.83 | 0.53 |
AUC, area under curve; NPV, negative predictive value; PPV, positive predictive value.
Based on Youden J and distance to (1, 1)