Living Lab Lecture No. 9: Language Models for Code Generation

On 7th April 2022 at 11:00 am our 9th Living Lab Lecture will take place. This time Klaudia-Doris Thellmann and Bernhard Stadler will talk about "Language Models for Code Generation".

Efforts to automatically generate source code from natural language instructions to overcome the human-machine language barrier have existed since the early days of computer science. As a result, numerous approaches have emerged over the last decades, ranging from statistical methods with focus on rule induction or probabilistic grammars to artificial neural networks. In the last few years, large-scale pre-trained neural language models have shown impressive performance on a variety of natural language processing tasks and have also become the basis for a growing number of programming-related tasks such as code completion or synthesizing code from natural language descriptions.

The ScaDS.AI scientific researchers Klaudia-Doris Thellmann and Bernhard Stadler will give an overview of state-of-the-art language models for program synthesis, present some basic characteristics of these models, and discuss several of their limitations. A critical weakness of these language models is still systematic reasoning, which is crucial for understanding the programming task at hand and generating program code. One possible direction of research that could help alleviate these limitations is the inclusion of structural knowledge – an attempt we have made in this regard and would like to briefly introduce.

The Living Lab Lecture Series is free for everyone.
Language: English

To join the lecture please click here: Living Lab Lecture #9