Events

ML-NYC Speaker Series: Evaluating and Understanding the In-context Learning Ability of Language Models

Speaker: He He

Location: Off-Campus

Date: Thursday, February 23, 2023

In-context learning is an emergent ability of large language models that enables adaptation to new tasks without parameter update. Our understanding of how it works and how it arises is still nascent. In this talk, I will first describe a more rigorous evaluation of how well these models can learn to reason in-context through chain-of-thought prompting. Next, I will introduce a simple method to optimize in-context learning using Transformer-based language models as a meta learner. Finally, I will talk about some preliminary work that investigates what properties of the pre-training data impact the resulting in-context learning ability.

Location: Flatiron Institute
Make sure to register on Eventbrite before you attend!
Registration: https://www.eventbrite.com/e/ml-nyc-speaker-series-he-he-tickets-541353381537