Dehghani, M., Gouws, S., Vinyals, O., Uszkoreit, J., and Łukasz
Kaiser. Universal transformers, 2019.
Devlin, J., Uesato, J., Bhupatiraju, S., Singh, R., rahman Mohamed,
A., and Kohli, P. Robustfill: Neural program learning under
noisy i/o. In ICML, 2017.
Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. Bert: Pre-
training of deep bidirectional transformers for language under-
standing. arXiv preprint arXiv:1810.04805, 2018.
Dhariwal, P., Jun, H., Payne, C., Kim, J. W., Radford, A., and
Sutskever, I. Jukebox: A generative model for music. arXiv
preprint arXiv:2005.00341, 2020.
Drain, D., Wu, C., Svyatkovskiy, A., and Sundaresan, N. Gener-
ating bug-fixes using pretrained transformers. Proceedings of
the 5th ACM SIGPLAN International Symposium on Machine
Programming, 2021.
Eghbal, N. Working in public: the making and maintenance of
open source software. Stripe Press, 2020.
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou,
L., Qin, B., Liu, T., Jiang, D., et al. Codebert: A pre-trained
model for programming and natural languages. In Proceed-
ings of the 2020 Conference on Empirical Methods in Natural
Language Processing (EMNLP), pp. 1536–1547, 2020.
Frey, C. B. The technology trap. Princeton University Press, 2019.
Gao, L., Biderman, S., Black, S., Golding, L., Hoppe, T., Foster,
C., Phang, J., He, H., Thite, A., Nabeshima, N., Presser, S.,
and Leahy, C. The pile: An 800gb dataset of diverse text for
language modeling. 2020.
Goldblum, M., Tsipras, D., Xie, C., Chen, X., Schwarzschild, A.,
Song, D., Madry, A., Li, B., and Goldstein, T. Dataset security
for machine learning: Data poisoning, backdoor attacks, and
defenses, 2021.
Goues, C. L., Dewey-Vogt, M., Forrest, S., and Weimer, W. A
systematic study of automated program repair: Fixing 55 out of
105 bugs for $8 each. 2012 34th International Conference on
Software Engineering (ICSE), pp. 3–13, 2012.
Graves, A. Generating sequences with recurrent neural networks,
2014.
Graves, A., Wayne, G., and Danihelka, I. Neural turing machines.
arXiv preprint arXiv:1410.5401, 2014.
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I.,
Grabska-Barwinska, A., Colmenarejo, S. G., Grefenstette, E.,
Ramalho, T., Agapiou, J., et al. Hybrid computing using a
neural network with dynamic external memory. Nature, 538
(7626):471–476, 2016.
Gulwani, S. Automating string processing in spreadsheets us-
ing input-output examples. In PoPL’11, January 26-28, 2011,
Austin, Texas, USA, January 2011.
Gulwani, S., Harris, W. R., and Singh, R. Spreadsheet data manip-
ulation using examples. Commun. ACM, 55:97–105, 2012.
He, P., Liu, X., Gao, J., and Chen, W. Deberta: Decoding-
enhanced bert with disentangled attention. arXiv preprint
arXiv:2006.03654, 2020.
Helmuth, T. and Spector, L. General program synthesis benchmark
suite. In Proceedings of the 2015 Annual Conference on Genetic
and Evolutionary Computation, pp. 1039–1046, 2015.
Hendrycks, D., Basart, S., Kadavath, S., Mazeika, M., Arora, A.,
Guo, E., Burns, C., Puranik, S., He, H., Song, D., et al. Mea-
suring coding challenge competence with apps. arXiv preprint
arXiv:2105.09938, 2021.
Hindle, A., Barr, E. T., Su, Z., Gabel, M., and Devanbu, P. On the
naturalness of software. In 2012 34th International Conference
on Software Engineering (ICSE), pp. 837–847. IEEE, 2012.
Holtzman, A., Buys, J., Du, L., Forbes, M., and Choi, Y. The
curious case of neural text degeneration, 2020.
Husain, H., Wu, H.-H., Gazit, T., Allamanis, M., and
Brockschmidt, M. Codesearchnet challenge: Evaluating the
state of semantic code search. ArXiv, abs/1909.09436, 2019.