Lab @ Lectures on Computational Linguistics 2023

I am glad to announce that on May 31 I will be hosting with Gabriele Sarti a laboratory focused on the interpretability of Neural Language Models (NLMs) at the 2023 edition of the Lectures on Computational Linguistics.
Below you can find title and abstract of the lab:

Title: Explaining Neural Language Models from Internal Representations to Model Predictions


Abstract: As language models become increasingly complex and sophisticated, the processes leading to their predictions are growing increasingly difficult to understand. Research in NLP interpretability focuses on explaining the rationales driving model predictions and is crucial for building trust and transparency in the usage of these systems in real-world scenarios. In this laboratory, we will explore various techniques for analyzing Neural Language Models, such as feature attribution methods and diagnostic classifiers. Besides common approaches to inspect models’ internal representations, we will also introduce prompting techniques to elicit model responses and motivate their usage as alternative methods for the behavioral study of model generations.


Location
Polo Piagge, University of Pisa, Pisa
Alessio Miaschi
Alessio Miaschi
Full-time researcher (RTDA) in Natural Language Processing