What are developers talking about? an analysis of topics and trends in stack overflow
Programming question and answer (Q&A) websites, such as Stack Overflow, leverage the
knowledge and expertise of users to provide answers to technical questions. Over time,
these websites turn into repositories of software engineering knowledge. Such knowledge
repositories can be invaluable for gaining insight into the use of specific technologies and
the trends of developer discussions. Previous work has focused on analyzing the user
activities or the social interactions in Q&A websites. However, analyzing the actual textual …
knowledge and expertise of users to provide answers to technical questions. Over time,
these websites turn into repositories of software engineering knowledge. Such knowledge
repositories can be invaluable for gaining insight into the use of specific technologies and
the trends of developer discussions. Previous work has focused on analyzing the user
activities or the social interactions in Q&A websites. However, analyzing the actual textual …
Abstract
Programming question and answer (Q&A) websites, such as Stack Overflow, leverage the knowledge and expertise of users to provide answers to technical questions. Over time, these websites turn into repositories of software engineering knowledge. Such knowledge repositories can be invaluable for gaining insight into the use of specific technologies and the trends of developer discussions. Previous work has focused on analyzing the user activities or the social interactions in Q&A websites. However, analyzing the actual textual content of these websites can help the software engineering community to better understand the thoughts and needs of developers. In the article, we present a methodology to analyze the textual content of Stack Overflow discussions. We use latent Dirichlet allocation (LDA), a statistical topic modeling technique, to automatically discover the main topics present in developer discussions. We analyze these discovered topics, as well as their relationships and trends over time, to gain insights into the development community. Our analysis allows us to make a number of interesting observations, including: the topics of interest to developers range widely from jobs to version control systems to C# syntax; questions in some topics lead to discussions in other topics; and the topics gaining the most popularity over time are web development (especially jQuery), mobile applications (especially Android), Git, and MySQL.
Springer