Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models
Recent advances in Large Language Models (LLM) have made automatic code generation
possible for real-world programming tasks in general-purpose programming languages …
possible for real-world programming tasks in general-purpose programming languages …
Self-edit: Fault-aware code editor for code generation
Large language models (LLMs) have demonstrated an impressive ability to generate codes
on competitive programming tasks. However, with limited sample numbers, LLMs still suffer …
on competitive programming tasks. However, with limited sample numbers, LLMs still suffer …
What is it like to program with artificial intelligence?
Large language models, such as OpenAI's codex and Deepmind's AlphaCode, can
generate code to solve a variety of problems expressed in natural language. This …
generate code to solve a variety of problems expressed in natural language. This …
No need to lift a finger anymore? assessing the quality of code generation by chatgpt
Large language models (LLMs) have demonstrated impressive capabilities across various
natural language processing (NLP) tasks, such as machine translation, question answering …
natural language processing (NLP) tasks, such as machine translation, question answering …
In-ide code generation from natural language: Promise and challenges
A great part of software development involves conceptualizing or communicating the
underlying procedures and logic that needs to be expressed in programs. One major …
underlying procedures and logic that needs to be expressed in programs. One major …
Discovering the syntax and strategies of natural language programming with generative language models
In this paper, we present a natural language code synthesis tool, GenLine, backed by 1) a
large generative language model and 2) a set of task-specific prompts that create or change …
large generative language model and 2) a set of task-specific prompts that create or change …
Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation
Program synthesis has been long studied with recent approaches focused on directly using
the power of Large Language Models (LLMs) to generate code. Programming benchmarks …
the power of Large Language Models (LLMs) to generate code. Programming benchmarks …
A study on robustness and reliability of large language model code generation
Recently, the large language models (LLMs) have shown extraordinary ability in
understanding natural language and generating programming code. It has been a common …
understanding natural language and generating programming code. It has been a common …
Craft: Customizing llms by creating and retrieving from specialized toolsets
Large language models (LLMs) are often augmented with tools to solve complex tasks. By
generating code snippets and executing them through task-specific Application …
generating code snippets and executing them through task-specific Application …
Exploring parameter-efficient fine-tuning techniques for code generation with large language models
Large Language Models (LLMs) possess impressive capabilities to generate meaningful
code snippets given natural language intents in zero-shot, ie, without the need for specific …
code snippets given natural language intents in zero-shot, ie, without the need for specific …