skip to main content
10.1145/3643664.3648201acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article
Open access

FAIR enough: a Vision for Research Objects in Empirical Software Engineering Studies

Published: 09 August 2024 Publication History

Abstract

In recent years, the software engineering research community has been fostering Open Science through several initiatives. Although the transparency fostered in Open Science can address some of the concerns related to appropriate study design and data analysis methods, the community still needs to fully embrace a set of guidelines for managing research data, such as FAIR principles. A fundamental aspect of FAIR is the Research Object---i.e., a bundle of research artifacts and their metadata. In this paper, I show an example of a Research Object and discuss how formalized metadata can benefit the community.

References

[1]
Sean Bechhofer, Iain Buchan, David De Roure, Paolo Missier, John Ainsworth, Jiten Bhagat, Philip Couch, Don Cruickshank, Mark Delderfield, Ian Dunlop, Matthew Gamble, Danius Michaelides, Stuart Owen, David Newman, Shoaib Sufi, and Carole Goble. 2013. Why linked data is not enough for scientists. Future Generation Computer Systems 29, 2 (2013), 599--611. Special section: Recent advances in e-Science.
[2]
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M Badia, Bartosz Balis, Tainä Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Daniel Garijo, Carole Goble, Dorran Howell, Shantenu Jha, Daniel S. Katz, Daniel Laney, Ulf Leser, Maciej Malawski, Kshitij Mehta, Loïc Pottier, Jonathan Ozik, J. Luc Peterson, Lavanya Ramakrishnan, Stian Soiland-Reyes, Douglas Thain, and Matthew Wolf. 2021. A Community Roadmap for Scientific Workflows Research and Development. In 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS). 81--90.
[3]
Romain David, Laurence Mabile, Alison Specht, Sarah Stryeck, Mogens Thomsen, Mohamed Yahia, Clement Jonquet, Laurent Dollé, Daniel Jacob, Daniele Bailo, Elena Bravo, Sophie Gachet, Hannah Gunderman, Jean-Eudes Hollebecq, Vassilios Ioannidis, Yvan Le Bras, Emilie Lerigoleur, Anne Cambon-Thomsen, The Research Data Alliance SHAring Reward Group, and (SHARC) Interest Credit. 2020. FAIRness Literacy: The Achilles' Heel of Applying FAIR Principles. Data Science Journal 19, 1 (2020).
[4]
Fabian Fagerholm, Michael Felderer, Davide Fucci, Michael Unterkalmsteiner, Bogdan Marculescu, Markus Martini, Lars Göran Wallgren Tengberg, Robert Feldt, Bettina Lehtelä, Balázs Nagyváradi, et al. 2022. Cognition in software engineering: A taxonomy and survey of a half-century of research. ACM Computing Surveys (CSUR) 54, 11s (2022), 1--36.
[5]
Julian Frattini, Lloyd Montgomery, Jannik Fischbach, Michael Unterkalmsteiner, Daniel Mendez, and Davide Fucci. 2022. A live extensible ontology of quality factors for textual requirements. In 2022 IEEE 30th International Requirements Engineering Conference (RE). IEEE, 274--280.
[6]
Davide Fucci. 2016. A Dissection of Test-Driven Development Process: Does It Really Matter to Test-First or to Test-Last? - Lab package. (6 2016).
[7]
Davide Fucci, Hakan Erdogmus, Burak Turhan, Markku Oivo, and Natalia Juristo. 2016. A dissection of the test-driven development process: Does it really matter to test-first or to test-last? IEEE Transactions on Software Engineering 43, 7 (2016), 597--614.
[8]
Wilhelm Hasselbring, Leslie Carr, Simon Hettrick, Heather Packer, and Thanassis Tiropanis. 2019. FAIR and open computer science research software. arXiv preprint arXiv:1908.05986 (2019).
[9]
Ben Hermann, Stefan Winter, and Janet Siegmund. 2020. Community expectations for research artifacts and evaluation processes. In Proceedings of the 28th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering. 469--480.
[10]
Annika Jacobsen, Ricardo de Miranda Azevedo, Nick Juty, Dominique Batista, Simon Coles, Ronald Cornet, Mélanie Courtot, Mercé Crosas, Michel Dumontier, Chris T. Evelo, Carole Goble, Giancarlo Guizzardi, Karsten Kryger Hansen, Ali Hasnain, Kristina Hettne, Jaap Heringa, Rob W.W. Hooft, Melanie Imming, Keith G. Jeffery, Rajaram Kaliyaperumal, Martijn G. Kersloot, Christine R. Kirkpatrick, Tobias Kuhn, Ignasi Labastida, Barbara Magagna, Peter McQuilton, Natalie Meyers, Annalisa Montesanti, Mirjam van Reisen, Philippe Rocca-Serra, Robert Pergl, Susanna-Assunta Sansone, Luiz Olavo Bonino da Silva Santos, Juliane Schneider, George Strawn, Mark Thompson, Andra Waagmeester, Tobias Weigel, Mark D. Wilkinson, Egon L. Willighagen, Peter Wittenburg, Marco Roos, Barend Mons, and Erik Schultes. [n. d.]. FAIR Principles: Interpretations and Implementation Considerations. Data Intelligence 2, 1-2 ([n.d.]), 10--29.
[11]
Darja Šmite, Claes Wohlin, Zane Galvina, and Rafael Prikladnicki. 2014. An empirically based terminology and taxonomy for global software engineering. Empirical Software Engineering 19 (2014), 105--153.
[12]
Christopher S. Timperley, Lauren Herckis, Claire Le Goues, and Michael Hilton. 2020. Understanding and Improving Artifact Sharing in Software Engineering Research. arXiv (2020), 2008.01046v2.
[13]
Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Mercé Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J.G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A.C 't Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serra, Marco Roos, Rene van Schaik, Susanna-Assunta Sansone, Erik Schultes, Thierry Sengstag, Ted Slater, George Strawn, Morris A. Swertz, Mark Thompson, Johan van der Lei, Erik van Mulligen, Jan Velterop, Andra Waagmeester, Peter Wittenburg, Katherine Wolstencroft, Jun Zhao, and Barend Mons. 2016. The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data 3, 1 (2016), 160018.

Index Terms

  1. FAIR enough: a Vision for Research Objects in Empirical Software Engineering Studies

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WSESE '24: Proceedings of the 1st IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering
      April 2024
      87 pages
      ISBN:9798400705670
      DOI:10.1145/3643664
      This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.

      Sponsors

      In-Cooperation

      • Faculty of Engineering of University of Porto

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 09 August 2024

      Check for updates

      Author Tags

      1. FAIR
      2. software engineering research
      3. empirical studies
      4. ontology
      5. metadata

      Qualifiers

      • Research-article

      Funding Sources

      • KKS foundation

      Conference

      WSESE '24
      Sponsor:

      Upcoming Conference

      ICSE 2025

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 28
        Total Downloads
      • Downloads (Last 12 months)28
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 24 Oct 2024

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Get Access

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media