Imagining a future of designing with ai: Dynamic grounding, constructive negotiation, and sustainable motivation

P Vaithilingam, I Arawjo, EL Glassman - Proceedings of the 2024 ACM …, 2024 - dl.acm.org
We ideate a future design workflow that involves AI technology. Drawing from activity and
communication theory, we attempt to isolate the new value that large AI models can provide …

Understanding the Human-LLM Dynamic: A Literature Survey of LLM Use in Programming Tasks

D Etsenake, M Nagappan - arXiv preprint arXiv:2410.01026, 2024 - arxiv.org
Large Language Models (LLMs) are transforming programming practices, offering significant
capabilities for code generation activities. While researchers have explored the potential of …

WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization

L Xie, C Zheng, H Xia, H Qu, C Zhu-Tian - Proceedings of the 37th …, 2024 - dl.acm.org
Large language models (LLMs) support data analysis through conversational user
interfaces, as exemplified in OpenAI's ChatGPT (formally known as Advanced Data Analysis …

DracoGPT: Extracting Visualization Design Preferences from Large Language Models

HW Wang, M Gordon, L Battle… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Trained on vast corpora, Large Language Models (LLMs) have the potential to encode
visualization design knowledge and best practices. However, if they fail to do so, they might …

ProvenanceWidgets: A Library of UI Control Elements to Track and Dynamically Overlay Analytic Provenance

A Narechania, K Odak, M El-Assady… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
We present ProvenanceWidgets, a Javascript library of UI control elements such as radio
buttons, checkboxes, and dropdowns to track and dynamically overlay a user's analytic …

DynEx: Dynamic Code Synthesis with Structured Design Exploration for Accelerated Exploratory Programming

J Ma, K Sreedhar, V Liu, S Wang, PA Perez… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent advancements in large language models have significantly expedited the process of
generating front-end code. This allows users to rapidly prototype user interfaces and ideate …

Functional Flexibility in Generative AI Interfaces: Text Editing with LLMs through Conversations, Toolbars, and Prompts

F Lehmann, D Buschek - arXiv preprint arXiv:2410.10644, 2024 - arxiv.org
Prompting-based user interfaces (UIs) shift the task of defining and accessing relevant
functions from developers to users. However, how UIs shape this flexibility has not yet been …

ChainBuddy: An AI Agent System for Generating LLM Pipelines

J Zhang, I Arawjo - arXiv preprint arXiv:2409.13588, 2024 - arxiv.org
As large language models (LLMs) advance, their potential applications have grown
significantly. However, it remains difficult to evaluate LLM behavior on user-specific tasks …

Data Formulator 2: Iteratively Creating Rich Visualizations with AI

C Wang, B Lee, S Drucker, D Marshall… - arXiv preprint arXiv …, 2024 - arxiv.org
To create rich visualizations, data analysts often need to iterate back and forth among data
processing and chart specification to achieve their goals. To achieve this, analysts need not …

Data Analysis in the Era of Generative AI

JP Inala, C Wang, S Drucker, G Ramos, V Dibia… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper explores the potential of AI-powered tools to reshape data analysis, focusing on
design considerations and challenges. We explore how the emergence of large language …