research-article

A Preliminary Study of Bots Usage in Open Source Community

Authors:

Yi TangAuthors Info & Claims

Internetware '22: Proceedings of the 13th Asia-Pacific Symposium on Internetware

Pages 175 - 180

https://doi.org/10.1145/3545258.3545284

Published: 15 September 2022 Publication History

Abstract

Bots are seen as a promising approach in software development, which help to deal with the ever-increasing complexity of modern software engineering and development. The number of bots in open source community, such as GitHub, has expanded substantially over the last three years. Due to its increasing popularity, it is essential to characterize the current usage of bots in practices. In this paper, we present an empirical study of bots usage in GitHub community. By analyzing 7,399 projects from GitHub, we find that 4,148 (56%) projects have used bots. Through automatic identification and manual detection, we collect a total of 196 bots. We then analyze and classify them into 4 categories and 14 topics. Finally, we discuss some raised implications for bots in current GitHub community.

References

[1]

Vahid Alizadeh, Mohamed Amine Ouali, Marouane Kessentini, and Meriem Chater. 2019. RefBot: Intelligent software refactoring bot. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, IEEE Press, San Diego, California, 823–834.

Digital Library

[2]

Hudson Borges, Andre Hora, and Marco Tulio Valente. 2016. Understanding the factors that impact the popularity of GitHub repositories. In 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 334–344.

[3]

Marina Cernat, Adelina Nicoleta Staicu, and Alin Stefanescu. 2020. Towards automated testing of RPA implementations. In Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation. Association for Computing Machinery, New York, NY, USA, 21–24.

Digital Library

[4]

Bruno da Silva, Chloe Hebert, Abhishu Rawka, and Siriwan Sereesathien. 2020. Robin: A Voice Controlled Virtual Teammate for Software Developers and Teams. In 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 789–791.

[5]

Robert Dale. 2016. The return of the chatbots. Natural Language Engineering 22, 5 (2016), 811–817.

[6]

Hamza Ed-Douibi, Gwendal Daniel, and Jordi Cabot. 2020. OpenAPI Bot: A chatbot to help you understand REST APIs. In International Conference on Web Engineering. Springer, 538–542.

Digital Library

[7]

Linda Erlenhov, Francisco Gomes de Oliveira Neto, Martin Chukaleski, and Samer Daknache. 2020. Challenges and guidelines on designing test cases for test bots. In Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops. Association for Computing Machinery, New York, NY, USA, 41–45.

Digital Library

[8]

Linda Erlenhov, Francisco Gomes de Oliveira Neto, Riccardo Scandariato, and Philipp Leitner. 2019. Current and future bots in software development. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 7–11.

Digital Library

[9]

Linda Erlenhov, Francisco Gomes de Oliveira Neto, and Philipp Leitner. 2020. An empirical study of bots in software development: Characteristics and challenges from a practitioner’s perspective. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Association for Computing Machinery, New York, NY, USA, 445–455.

Digital Library

[10]

Umer Farooq and Jonathan Grudin. 2016. Human-computer integration. interactions 23, 6 (2016), 26–32.

Digital Library

[11]

Mehdi Golzadeh, Alexandre Decan, Damien Legay, and Tom Mens. 2021. A ground-truth dataset and classification model for detecting bots in GitHub issue and PR comments. Journal of Systems and Software 175 (2021), 110911.

[12]

Carlene Lebeuf, Alexey Zagalsky, Matthieu Foucault, and Margaret-Anne Storey. 2019. Defining and classifying software bots: A faceted taxonomy. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 1–6.

Digital Library

[13]

Carlene R Lebeuf. 2018. A taxonomy of software bots: towards a deeper understanding of software bot characteristics. Ph. D. Dissertation. University of Victoria.

[14]

Christoph Matthies, Franziska Dobrigkeit, and Guenter Hesse. 2019. An additional set of (automated) eyes: Chatbots for agile retrospectives. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 34–37.

Digital Library

[15]

Elahe Paikari and André Van Der Hoek. 2018. A framework for understanding chatbots and their future. In 2018 IEEE/ACM 11th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). IEEE, 13–16.

Digital Library

[16]

Margaret-Anne Storey and Alexey Zagalsky. 2016. Disrupting Developer Productivity One Bot at a Time. In Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (Seattle, WA, USA) (FSE 2016). Association for Computing Machinery, New York, NY, USA, 928–931. https://doi.org/10.1145/2950290.2983989

Digital Library

[17]

Yuan Tian, Ferdian Thung, Abhishek Sharma, and David Lo. 2017. APIBot: Question answering bot for API documentation. In 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 153–158.

[18]

Simon Urli, Zhongxing Yu, Lionel Seinturier, and Martin Monperrus. 2018. How to design a program repair bot? insights from the repairnator project. In 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 95–104.

[19]

Rijnard van Tonder and Claire Le Goues. 2019. Towards s/engineer/bot: Principles for program repair bots. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 43–47.

Digital Library

[20]

C Vouillon. 2015. Software bots: From do-it-yourself companion bots to ai powered software.

[21]

Mairieli Wessel, Bruno Mendes De Souza, Igor Steinmacher, Igor S Wiese, Ivanilton Polato, Ana Paula Chaves, and Marco A Gerosa. 2018. The power of bots: Characterizing and understanding bots in oss projects. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–19.

Digital Library

[22]

Mairieli Wessel, Igor Steinmacher, Igor Wiese, and Marco A Gerosa. 2019. Should i stale or should i close? an analysis of a bot that closes abandoned issues and pull requests. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 38–42.

Digital Library

[23]

Menghan Wu, Yang Zhang, Jiakun Liu, Shangwen Wang, Zhang Zhang, Xin Xia, and Xinjun Mao. 2022. On the Way to Microservices: Exploring Problems and Solutions from Online Q&A Community. In IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE Computer Society, 421–432.

[24]

Marvin Wyrich and Justus Bogner. 2019. Towards an autonomous bot for automatic source code refactoring. In 2019 IEEE/ACM 1st International Workshop on Bots in Software Engineering (BotSE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 24–28.

Digital Library

[25]

Marvin Wyrich, Raoul Ghit, Tobias Haller, and Christian Müller. 2021. Bots Don’t Mind Waiting, Do They? Comparing the Interaction With Automatically and Manually Created Pull Requests. arXiv e-prints (2021), arXiv–2103.

[26]

Bowen Xu, Zhenchang Xing, Xin Xia, and David Lo. 2017. AnswerBot: Automated generation of answer summary to developers’ technical questions. In 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, IEEE Computer Society, Los Alamitos, CA, USA, 706–716.

Cited By

Zhang JWu XZhang YXu S(2023)Detecting Bot on GitHub Leveraging Transformer-based Models: A Preliminary Study2023 30th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC60848.2023.00087(639-640)Online publication date: 4-Dec-2023
https://doi.org/10.1109/APSEC60848.2023.00087
Gao AZhang YWang TChen SDeng J(2022)How Does Bot Affect Developer’s Sentiment: An Empirical Study on GitHub Issues and PRs2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00268(1856-1861)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00268

Index Terms

A Preliminary Study of Bots Usage in Open Source Community
1. General and reference
  1. Cross-computing tools and techniques
    1. Empirical studies

Recommendations

The Power of Bots: Characterizing and Understanding Bots in OSS Projects

Leveraging the pull request model of social coding platforms, Open Source Software (OSS) integrators review developers' contributions, checking aspects like license, code quality, and testability. Some projects use bots to automate predefined, sometimes ...
Humans and bots in internet chat: measurement, analysis, and automated classification

The abuse of chat services by automated programs, known as chat bots, poses a serious threat to Internet users. Chat bots target popular chat networks to distribute spam and malware. In this paper, we first conduct a series of measurements on a large0 ...
The Impact of Memory-Efficient Bots on IoT-WSN Botnet Propagation
Abstract
By successfully infecting certain numbers of nodes in an Internet of Things (IoT) platform, botmaster often relies on specific bots (infected nodes) to scan and gather information about the target nodes for onward propagation of the attack. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

Internetware '22: Proceedings of the 13th Asia-Pacific Symposium on Internetware

June 2022

291 pages

ISBN:9781450397803

DOI:10.1145/3545258

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Program of A New Generation of Artificial Intelligence 2030

Conference

Internetware 2022

Internetware 2022: 13th Asia-Pacific Symposium on Internetware

June 11 - 12, 2022

Hohhot, China

Acceptance Rates

Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
65
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang JWu XZhang YXu S(2023)Detecting Bot on GitHub Leveraging Transformer-based Models: A Preliminary Study2023 30th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC60848.2023.00087(639-640)Online publication date: 4-Dec-2023
https://doi.org/10.1109/APSEC60848.2023.00087
Gao AZhang YWang TChen SDeng J(2022)How Does Bot Affect Developer’s Sentiment: An Empirical Study on GitHub Issues and PRs2022 IEEE Smartworld, Ubiquitous Intelligence & Computing, Scalable Computing & Communications, Digital Twin, Privacy Computing, Metaverse, Autonomous & Trusted Vehicles (SmartWorld/UIC/ScalCom/DigitalTwin/PriComp/Meta)10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00268(1856-1861)Online publication date: Dec-2022
https://doi.org/10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00268

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents