How good is your synthetic data? SynthRO, a dashboard to evaluate and benchmark synthetic tabular data

Table 1 List of open-source tools that perform an evaluation of synthetic data utility, resemblance, and privacy

Tool	Description	Metrics	GUI	Report	Benchmarking
Synthetic Data Vault [28] (SDGym and SDGMetrics module)	Python package to generate and evaluate	resemblance, privacy	no	yes	no
SDNist [29]	Python package for evaluation	resemblance, utility, privacy	no	yes	no
Anonymeter [30]	Python package to evaluate privacy	privacy	no	no	no
SynthGauge [31]	Python package	utility, privacy	no	no	no
synthpop [32]	R library	utility	no	no	no
Gretel.ai [33]	Dashboard to generate and summary evaluate	resemblance, privacy	yes	yes	no
SynthEval [34]	Python package for evaluation	resemblance, utility, privacy	no	no	no
Synthcity [35]	Python package for evaluation	resemblance, utility, privacy	no	no	yes
SynthCheck [26]	Python package for evaluation	resemblance, utility, privacy	yes	yes	no
SynthRO (our proposed tool)	Python package for evaluation and benchmarking	resemblance, utility, privacy	yes	yes	yes

ISSN: 1472-6947