Skip to main content

Table 11 Validation on real narratives with fine-tuned models using narratives generated through P2-1

From: The aluminum standard: using generative Artificial Intelligence tools to synthesize and annotate non-structured patient data

Models

Metrics

P

R

F1

bert-base-german-cased

Exact

0.42

0.096

0.15

Partial

0.6

0.13

0.22

Entity Type

0.78

0.179

0.29

SCAI-BIO/ BioGottBERT -base

Exact

0.38

0.09

0.14

Partial

0.57

0.13

0.22

Entity Type

0.76

0.18

0.29

allenai/scibert_scivocab_uncased

Exact

0.39

0.13

0.19

Partial

0.56

0.18

0.28

Entity Type

0.72

0.24

0.36