Models | Cohorts | AUC (95% CI) | Sensitivity (%) (95% CI) | Specificity (%) (95% CI) | Accuracy (%) (95% CI) | PPV (%) (95% CI) | NPV (%) (95% CI) |
---|---|---|---|---|---|---|---|
Clinical | Training set | 0.690 (0.611–0.761) | 74.29 (26/35) (59.81–88.77) | 55.37 (67/121) (46.51–64.23) | 59.62 (93/156) (51.92–67.32) | 32.50 (26/80) (22.24–42.76) | 88.16 (67/76) (80.89–95.42) |
 | Validation set 1 | 0.648 (0.543–0.745) | 56.52 (13/23) (36.81–74.37) | 70.00 (49/70) (59.36–80.74) | 66.67 (62/93) (57.09–76.25) | 38.24 (13/34) (21.90-54.57) | 83.05 (49/59) (73.48–92.62) |
 | Validation set 2 | 0.634 (0.548–0.714) | 68.00 (17/25) (48.41–82.79) | 51.75 (59/114) (42.58–60.93) | 54.68 (76/139) (46.40-62.95) | 23.61 (17/72) (13.80-33.42) | 88.06 (59/67) (80.30-95.82) |
 | Validation set 3 | 0.663 (0.570–748) | 79.17 (19/24) (59.93–90.76) | 58.06 (54/93) (48.04–68.10) | 62.39 (73/117) (52.36–71.17) | 32.76 (19/58) (20.68–44.84) | 91.53 (54/59) (84.42–98.63) |
GPTV3 Radiomics | Training set | 0.912 (0.855–0.951) | 85.71 (30/35) (74.12–97.31) | 85.12 (103/121) (78.78–91.46) | 85.26 (133/156) (79.69–90.82) | 62.50 (30/48) (48.80–76.20) | 95.37 (103/108) (48.80–76.20) |
 | Validation set 1 | 0.822 (0.729–0.894) | 86.96 (20/23) (67.87–95.46) | 71.43 (50/70) (60.85–82.01) | 75.27 (70/93) (66.50-84.04) | 50.00 (20/40) (34.50–65.50) | 94.34 (50/53) (84.63–98.06) |
 | Validation set 2 | 0.841 (0.769–0.897) | 76.00 (19/25) (59.26–92.74) | 84.21 (96/114) (77.52–90.90) | 82.73 (115/139) (76.45–89.20) | 51.35 (19/37) (35.25–67.46) | 94.12 (96/102) (89.55–98.68) |
 | Validation set 3 | 0.771 (0.685–0.844) | 75.00 (18/24) (57.68–92.32) | 73.12 (68/93) (64.11–82.31) | 73.50 (86/117) (65.51–81.50) | 41.86 (18/43) (27.11–56.61) | 91.89 (68/74) (85.67–98.11) |
Nomogram | Training set | 0.951 (0.904–0.979) | 85.71 (30/35) (74.21–97.31) | 92.56 (112/121) (88.05–97.56) | 91.03 (142/156) (87.51–95.45) | 76.92 (30/39) (62.50-88.39) | 95.73 (112/117) (92.81–98.49) |
 | Validation set 1 | 0.855 (0.766–0.919) | 78.26 (18/23) (61.40-95.12) | 87.14 (61/70) (77.96–94.74) | 84.95 (79/93) (76.13–91.52) | 66.67 (18/27) (47.82–84.35) | 92.42 (61/66) (86.33–97.77) |
 | Validation set 2 | 0.882 (0.801–0.962) | 76.00 (19/25) (56.57–88.50) | 92.98 (106/114) (87.65–97.46) | 89.93 (125/139) (85.81–92.56) | 70.37 (19/27) (52.82–86.82) | 94.64 (106/112) (89.20-98.07) |
 | Validation set 3 | 0.810 (0.727–0.877) | 70.83 (17/24) (50.83–85.09) | 79.57 (74/93) (71.24–86.46) | 77.78 (91/117) (69.63–85.45) | 47.22 (17/36) (30.45–61.83) | 91.36 (74/81) (84.99–97.13) |