AI Assistant in JetBrains IDE: Insights and Challenges (Invited Talk)

Frontier Large language models in 2024 are capable of performing numerous tasks, including SE ones, and are widely used to create impressive demos. However, productizing these models remains notoriously challenging. JetBrains AI Assistant is one such product, a developer tool, that provides IDE users with over 10 different features backed by latest LLMs. It supports various programming languages and is shipped in a number of different IDE products (IntelliJ, Rider, PyCharm, Goland, PhpStorm, etc). In this session we will share the story of deploying LLM-based features to production over the past year developing AI Assistant: technical successes, challenges, and capabilities we believe LLMs pre-trained on code are still lacking in the SE context, from the perspective of an industrial developer tools vendor.