Skip to main content

Table 2 Implemented criteria for assigning ranks in a ranking list, divided by metric

From: How good is your synthetic data? SynthRO, a dashboard to evaluate and benchmark synthetic tabular data

Metrics Categorization

Low Rank Criteria

Resemblance

URA

Numerical tests

% accepted features ↑

Categorical tests

% rejected features ↑

Distance metrics

Average distance ↓

MRA

Correlation matrices

Average matrices difference ↓

Contingency tables

Average tables difference ↓

Principal Component Analysis

RMSE real vs. synthetic ↓

DLA

Average F1 score ↓

Utility

TRTR vs. TSTR

Average F1 scores difference ↓

Privacy

SEA

Cosine similarity

Average distance ↓

Euclidean distance

Average distance ↑

Hausdorff distance

Average distance ↑

MIA

Accuracy ↓

AIA

Accuracy ↓

RMSE ↑