research-article

Towards Using Few-Shot Prompt Learning for Automating Model Completion

Authors:

Meriem Ben Chaaben,

Lola Burgueño,

Houari SahraouiAuthors Info & Claims

ICSE-NIER '23: Proceedings of the 45th International Conference on Software Engineering: New Ideas and Emerging Results

Pages 7 - 12

https://doi.org/10.1109/ICSE-NIER58687.2023.00008

Published: 20 September 2023 Publication History

Get Access

Abstract

We propose a simple yet a novel approach to improve completion in domain modeling activities. Our approach exploits the power of large language models by using few-shot prompt learning without the need to train or fine-tune those models with large datasets that are scarce in this field. We implemented our approach and tested it on the completion of static and dynamic domain diagrams. Our initial evaluation shows that such an approach is effective and can be integrated in different ways during the modeling activities.

References

[1]

J. D. Rocco, C. D. Sipio, D. D. Ruscio, and P. T. Nguyen, "A gnn-based recommender system to assist the specification of metamodels and models," in 24th International Conference on Model Driven Engineering Languages and Systems (MODELS 2022). IEEE, 2021, pp. 70--81. [Online].

Crossref

Google Scholar

[2]

M. Weyssow, H. A. Sahraoui, and E. Syriani, "Recommending metamodel concepts during modeling activities with pre-trained language models," Software and Systems Modeling, vol. 21, no. 3, pp. 1071--1089, 2022. [Online].

Digital Library

Google Scholar

[3]

R. Saini, G. Mussbacher, J. L. C. Guo, and J. Kienzle, "Automated, interactive, and traceable domain modelling empowered by artificial intelligence," Software and Systems Modeling, vol. 21, no. 3, pp. 1015--1045, 2022. [Online].

Digital Library

Google Scholar

[4]

T. Capuano, H. A. Sahraoui, B. Frénay, and B. Vanderose, "Learning from code repositories to recommend model classes," Journal of Object Technology, vol. 21, no. 3, pp. 3:1--11, 2022. [Online].

Crossref

Google Scholar

[5]

L. Burgueño, R. Clarisó, S. Gérard, S. Li, and J. Cabot, "An nlp-based architecture for the autocompletion of partial domain models," in Prof. of the 33rd International Conference on Advanced Information Systems Engineering (CAiSE 2021), ser. Lecture Notes in Computer Science, M. L. Rosa, S. W. Sadiq, and E. Teniente, Eds., vol. 12751. Springer, 2021, pp. 91--106. [Online].

Digital Library

Google Scholar

[6]

"GitHub Copilot your ai pair programmer," https://github.com/features/copilot/, [Online; accessed 10-January-2023].

Google Scholar

[7]

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, "Language models are few-shot learners," in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6--12, 2020, virtual, H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., 2020.

Google Scholar

[8]

J. Rumbaugh, I. Jacobson, and G. Booch, Unified Modeling Language Reference Manual, version 2.1.1. OMG, 2007. [Online]. Available: http://www.omg.org/technology/documents/formal/uml.htm

Google Scholar

[9]

"UML activity diagram examples," https://www.uml-diagrams.org/activity-diagrams-examples.html, [Online; accessed 12-October-2022].

Google Scholar

[10]

J. A. Hernández López, J. L. Cánovas Izquierdo, and J. Sánchez Cuadrado, "Modelset: a dataset for machine learning in model-driven engineering," Software and Systems Modeling, vol. 21, no. 3, pp. 967--986, 2022.

Digital Library

Google Scholar

[11]

M. B. Chaaben, L. Burgueño, and H. Sahraoui, 2023. [Online]. Available: http://hdl.handle.net/20.500.12004/1/C/ICSE/2023/001

Google Scholar

Cited By

View all

Muttillo VDi Sipio CRubei RBerardinelli LDehghani MFilkov VRay BZhou M(2024)Towards Synthetic Trace Generation of Modeling Operations using In-Context Learning ApproachProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695058(619-630)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695058
Pontes Miranda JBruneliere HTisi MSunyé GLaemmel RPereira JMosses P(2024)Towards an In-Context LLM-Based Approach for Automating the Definition of Model ViewsProceedings of the 17th ACM SIGPLAN International Conference on Software Language Engineering10.1145/3687997.3695650(29-42)Online publication date: 17-Oct-2024
https://dl.acm.org/doi/10.1145/3687997.3695650
Dridi JAmayri MBouguila N(2024)Unsupervised Adversarial Domain Adaptation for Estimating Occupancy and Recognizing Activities in Smart BuildingsProceedings of the 2024 9th International Conference on Intelligent Information Technology10.1145/3654522.3654541(114-123)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3654522.3654541
Show More Cited By

Recommendations

Prompt-Based Self-training Framework for Few-Shot Named Entity Recognition
Knowledge Science, Engineering and Management
Abstract
Exploiting unlabeled data is one of the plausible methods to improve few-shot named entity recognition (few-shot NER), where only a small number of labeled examples are given for each entity type. Existing works focus on learning deep NER models ...
Few-Shot Domain Adaptation via Prompt-Guided Multi-prototype Alignment Network
Advanced Intelligent Computing Technology and Applications
Abstract
Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. However, scarcity of labeled source domain samples in practical scenarios due to high annotation costs or difficulty in ...
Label Prompt Guiding for Two-Stage Few-Shot Named Entity Recognition
Advanced Intelligent Computing Technology and Applications
Abstract
Although the current two-stage prototypical network approach based on pretrained language models has achieved success in few-shot named entity recognition (NER) tasks, the span boundary at the entity span detection stage is still difficult to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICSE-NIER '23: Proceedings of the 45th International Conference on Software Engineering: New Ideas and Emerging Results

May 2023

159 pages

ISBN:9798350300390

Conference Chairs:
Gabriele Bavota
USI Università della Svizzera italiana, Switzerland
,
Dan Hao
Peking University, China

In-Cooperation

IEEE CS

Publisher

IEEE Press

Publication History

Published: 20 September 2023

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE-NIER '23

Sponsor:

SIGSOFT

ICSE-NIER '23: 45th International Conference on Software Engineering: New Ideas and Emerging Results

May 17 - 19, 2023

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
51
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)8

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Muttillo VDi Sipio CRubei RBerardinelli LDehghani MFilkov VRay BZhou M(2024)Towards Synthetic Trace Generation of Modeling Operations using In-Context Learning ApproachProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695058(619-630)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695058
Pontes Miranda JBruneliere HTisi MSunyé GLaemmel RPereira JMosses P(2024)Towards an In-Context LLM-Based Approach for Automating the Definition of Model ViewsProceedings of the 17th ACM SIGPLAN International Conference on Software Language Engineering10.1145/3687997.3695650(29-42)Online publication date: 17-Oct-2024
https://dl.acm.org/doi/10.1145/3687997.3695650
Dridi JAmayri MBouguila N(2024)Unsupervised Adversarial Domain Adaptation for Estimating Occupancy and Recognizing Activities in Smart BuildingsProceedings of the 2024 9th International Conference on Intelligent Information Technology10.1145/3654522.3654541(114-123)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3654522.3654541
Abukhalaf SHamdaqa MKhomh FLo DPenta MXia XHu X(2024)PathOCL: Path-Based Prompt Augmentation for OCL Generation with GPT-4Proceedings of the 2024 IEEE/ACM First International Conference on AI Foundation Models and Software Engineering10.1145/3650105.3652290(108-118)Online publication date: 14-Apr-2024
https://dl.acm.org/doi/10.1145/3650105.3652290
Costa CLópez JCuadrado JEgyed AWimmer MChechik MCombemale B(2024)ModelMate: A recommender for textual modeling languages based on pre-trained language modelsProceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems10.1145/3640310.3674089(183-194)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640310.3674089
Marcén AIglesias ALapeña RPérez FCetina C(2024)A Systematic Literature Review of Model-Driven Engineering Using Machine LearningIEEE Transactions on Software Engineering10.1109/TSE.2024.343051450:9(2269-2293)Online publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1109/TSE.2024.3430514

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Prompt-Based Self-training Framework for Few-Shot Named Entity Recognition

Few-Shot Domain Adaptation via Prompt-Guided Multi-prototype Alignment Network

Label Prompt Guiding for Two-Stage Few-Shot Named Entity Recognition