"If the Machine Is As Good As Me, Then What Use Am I?" – How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishment
Abstract
1 Introduction
2 Related Work
2.1 Productivity in Knowledge Work
2.2 Self-Efficacy and Personal Accomplishment
3 Methods Overview
4 Phase 1: Pre-study Methods & Results
4.1 Methods
4.2 Results
5 Phase 2: Diary Study Methods
5.1 Participants
5.2 Study Setup & Procedure
6 Results of the Diary Study
6.1 Drivers for Sense of Accomplishment
6.2 Barriers to Sense of Accomplishment
6.3 Drivers for Perceived Productivity
6.4 Barriers to Perceived Productivity
6.5 The Interplay of Personal Accomplishment and Productivity
Theme | Subtheme | Quote |
---|---|---|
Drivers for Sense of Accomplishment | Sense ofOwnership | “The quintessence and the content was still mine, but it was just packaged nicer. So, in a way, it just made my “intellectual property better accessible.” [P6] |
Smart Use ofChatGPT | “I think we made smart use of the technology and achieved good results.” [P15] | |
Task Completion | “I took the answer for granted and was able to complete this part of my work. Whether it was true, I don’t know.” [P8] | |
Barriers to Sense of Accomplishment | Lack of Challenge | “I feel accomplished due to my progress, but prompting required so little work, that it doesn’t feel like I worked enough.” [P3] |
Prompting Difficulties | “I felt a sense of accomplishment, but annoyed a couple of times as well when ChatGPT does not realize my prompts as I would like it to do.” [P9] | |
QualityDissatisfaction | “You can generate a lot of results, but they lack quality if you don’t have the time to dig deeper yourself.” [P14] | |
Diminished Sense ofOwnership | “Hm - on the one hand, I delivered a high-quality work - on the other hand: It was not “my” work, but ChatGPT’s work.” [P11] | |
Inferiority | “So it’s sometimes sad to see that your own creativity can not compete most of the time.” [P6] | |
Drivers for Perceived Productivity | Time Efficiency | “ChatGPT enabled us to come up with ideas super quickly, and that would not have been possible as fast without it.” [P15] |
Increased Output | “I could generate a lot of questions.” [P14] | |
Outsourcing | “It would give me a lot of time left to do other stuff.” [P3] | |
Lowering Entry BarrierforInformation Gathering | “I can have more output in less time; with ChatGPT I save the whole 0% to 40% part and can fully concentrate on bringing it from 40% to 100%.” [P14] | |
Barriers to Perceived Productivity | Limited Reliability | “Quality is different depending on the topic/request and the data has always to be validated through other sources.” [P9] |
Grammar andSpelling Issues | “Overall helpful, but grammar and writing not always correct, so additional time to fix it needed.” [P19] | |
Generic Output | “In the last research session, ChatGPT did not convince me to dive deeper and not only scratch the surface; I already had the overview and wanted to dive deeper, so I did it by myself reading scientific papers.” [P14] |
7 Discussion
7.1 Perceived Accomplishment Using LLMs
7.1.1 Successful Prompting Fosters Sense of Accomplishment.
7.1.2 Automation Impacts Ownership.
7.2 Perceived Productivity Using LLMs
7.2.1 Optimising for Objective Productivity.
7.2.2 Optimising for Perceived Productivity.
7.3 Usage of LLMs
7.3.1 When Not to Use LLMs.
7.3.2 Insights on LLM Best Practices.
7.4 Limitations & Future Work
8 Conclusion
A Pre-study Interview Script and Guide
B Diary Study Survey
C Exit Interview Script and Guide
Footnotes
Supplemental Material
- Download
- 147.29 MB
- Transcript
References
Index Terms
- "If the Machine Is As Good As Me, Then What Use Am I?" – How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishment
Recommendations
Understanding Personal Productivity: How Knowledge Workers Define, Evaluate, and Reflect on Their Productivity
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsProductivity tracking tools often determine productivity based on the time interacting with work-related applications. To deconstruct productivity's diverse and nebulous nature, we investigate how knowledge workers conceptualize personal productivity ...
Job Hopping, Information Technology Spillovers, and Productivity Growth
The movement of information technology IT workers among firms is believed to be an important mechanism by which IT-related innovations diffuse throughout the economy. We use a newly developed source of employee microdata---an online resume database---to ...
Attracting Young IT Professionals: An Empirical Study Using the Theory of Attractive Quality
SIGMIS-CPR '19: Proceedings of the 2019 on Computers and People Research ConferenceAttracting and recruiting qualified information technology (IT) professionals remains one key issue for executives for numerous years. The so-called war for IT talent illustrates the hard competition of employers for well-educated IT professionals who ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 2,070Total Downloads
- Downloads (Last 12 months)2,070
- Downloads (Last 6 weeks)548
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in