Diagnosis extraction from unstructured Dutch echocardiogram reports using span- and document-level characteristic classification

Arends, Bauke; Vessies, Melle; van Osch, Dirk; Teske, Arco; van der Harst, Pim; van Es, René; van Es, Bram

doi:10.1186/s12911-025-02897-w

BMC Medical Informatics and Decision Making

Table 12 Semantic performance of document classification methods for simplified label scheme (No label, Normal, and Present)

From: Diagnosis extraction from unstructured Dutch echocardiogram reports using span- and document-level characteristic classification

	BOW			SetFit (RobBERT)			MedRoBERTa.nl			biGRU			CNN
Characteristic	F1	recall	precision	F1	recall	precision	F1	recall	precision	F1	recall	precision	F1	recall	precision
Aortic regurgitation	0.92 (0.89)	0.92 (0.88)	0.92 (0.89)	0.94 (0.93)	0.94 (0.94)	0.94 (0.91)	0.97 (0.97)	0.97 (0.97)	0.97 (0.97)	0.96 (0.95)	0.96 (0.95)	0.96 (0.96)	0.96 (0.96)	0.96 (0.95)	0.96 (0.96)
Aortic stenosis	0.94 (0.89)	0.94 (0.88)	0.94 (0.90)	0.91 (0.86)	0.91 (0.94)	0.91 (0.82)	0.95 (0.93)	0.95 (0.95)	0.95 (0.93)	0.95 (0.93)	0.95 (0.94)	0.95 (0.92)	0.96 (0.94)	0.96 (0.95)	0.96 (0.95)
Diastolic dysfunction	0.94 (0.91)	0.94 (0.90)	0.94 (0.91)	0.95 (0.92)	0.95 (0.97)	0.95 (0.89)	0.97 (0.96)	0.97 (0.97)	0.97 (0.96)	0.96 (0.94)	0.96 (0.95)	0.96 (0.92)	0.96 (0.95)	0.96 (0.95)	0.97 (0.95)
Left ventricular dilatation	0.88 (0.82)	0.88 (0.81)	0.88 (0.84)	0.95 (0.94)	0.95 (0.96)	0.95 (0.93)	0.96 (0.94)	0.96 (0.95)	0.96 (0.94)	0.95 (0.94)	0.95 (0.94)	0.95 (0.94)	0.96 (0.95)	0.96 (0.95)	0.96 (0.95)
Left ventricular systolic dysfunction	0.92 (0.90)	0.92 (0.89)	0.92 (0.90)	0.96 (0.94)	0.96 (0.95)	0.96 (0.93)	0.97 (0.95)	0.97 (0.95)	0.97 (0.95)	0.96 (0.94)	0.96 (0.94)	0.97 (0.94)	0.96 (0.94)	0.96 (0.93)	0.96 (0.94)
Mitral regurgitation	0.90 (0.88)	0.90 (0.88)	0.90 (0.89)	0.94 (0.94)	0.94 (0.95)	0.94 (0.93)	0.97 (0.97)	0.97 (0.97)	0.97 (0.96)	0.95 (0.94)	0.94 (0.95)	0.95 (0.94)	0.96 (0.95)	0.96 (0.96)	0.96 (0.95)
Pericardial effusion	0.96 (0.84)	0.97 (0.82)	0.96 (0.88)	0.95 (0.85)	0.95 (0.93)	0.95 (0.79)	0.99 (0.95)	0.99 (0.96)	0.99 (0.94)	0.98 (0.94)	0.98 (0.95)	0.98 (0.94)	0.98 (0.94)	0.98 (0.94)	0.98 (0.95)
Right ventricular dilatation	0.87 (0.79)	0.88 (0.77)	0.87 (0.81)	0.91 (0.86)	0.91 (0.91)	0.91 (0.83)	0.95 (0.93)	0.95 (0.95)	0.96 (0.92)	0.94 (0.92)	0.94 (0.92)	0.94 (0.92)	0.95 (0.92)	0.95 (0.93)	0.95 (0.92)
Right ventricular systolic dysfunction	0.91 (0.86)	0.90 (0.85)	0.90 (0.87)	0.93 (0.91)	0.93 (0.94)	0.93 (0.90)	0.97 (0.95)	0.97 (0.94)	0.97 (0.96)	0.94 (0.92)	0.94 (0.91)	0.94 (0.93)	0.94 (0.92)	0.94 (0.92)	0.95 (0.93)
Tricuspid regurgitation	0.93 (0.90)	0.93 (0.90)	0.93 (0.89)	0.93 (0.91)	0.93 (0.93)	0.93 (0.89)	0.97 (0.97)	0.97 (0.96)	0.97 (0.97)	0.96 (0.95)	0.96 (0.95)	0.96 (0.95)	0.97 (0.96)	0.97 (0.96)	0.97 (0.95)
Wall motion abnormalities	0.94 (0.90)	0.94 (0.85)	0.94 (0.92)	0.95 (0.92)	0.95 (0.93)	0.95 (0.91)	0.97 (0.95)	0.97 (0.94)	0.97 (0.96)	0.96 (0.93)	0.96 (0.90)	0.96 (0.96)	0.97 (0.94)	0.97 (0.93)	0.97 (0.96)

Weighted and macro (in brackets) scores. The highest performance for each characteristic is denoted in bold

Back to article page

ISSN: 1472-6947

Contact us

General enquiries: journalsubmissions@springernature.com