Published September 29, 2021 | Version V0.1
Dataset Open

Comparison results of FAIR Evaluation tools

  • 1. Sun
  • 2. Emonet
  • 3. Dumontier

Description

We studied and compared three automated FAIRness evaluation tools namely F-UJI, the FAIR Evaluator, and FAIR Checker examining three aspects: 1) tool characteristics, 2) the evaluation metrics, and 3) metrics tests for three public datasets. We find significant differences in the evaluation results for tested resources, along with differences in the design, implementation, and documentation of the evaluation metrics and platforms.

This data is the comparison results we summarized from the study. All results are reported in our manuscript. This data is the supplementary material of the manuscript. 

Files

Files (83.6 kB)

Name Size Download all
md5:bcd1cff82315bcbe8303eec6abcea7fb
83.6 kB Download

Additional details

References

  • M. D. Wilkinson, M. Dumontier, S.-A. Sansone, L. O. B. da Silva Santos, M. Prieto,D. Batista, P. McQuilton, T. Kuhn, P. Rocca-Serra, M. Crosas,et al., "Evaluatingfair maturity through a scalable, automated, community-governed framework,"Scientific data, vol. 6, no. 1, pp. 1–12, 2019
  • M. D. Wilkinson, S.-A. Sansone, E. Schultes, P. Doorn, L. O. B. da Silva San-tos, and M. Dumontier, "A design framework and exemplar metrics for fairness,"Scientific data, vol. 5, no. 1, pp. 1–4, 2018
  • A. Devaraju, R. Huber, M. Mokrane, P. Herterich, L. Cepinskas, J. de Vries,H. L'Hours, J. Davidson, and A. White, "Fairsfair data object assessment met-rics,"Zenodo, Jul, vol. 10, 2020.