Stealing a Generative AI's Secrets (Responsibly)

Speaker: Florian Tramèr

Location: 60 Fifth Avenue, Room 446
Videoconference link: https://nyu.zoom.us/j/98387069811

Date: Friday, April 12, 2024

Companies that develop generative AI tools, such as ChatGPT, keep most development and deployment details secret. We typically don't know what the underlying model looks like (or how big it is), what it was trained on, or what safety measures are applied. In this talk, I'll show how we reverse-engineered such secrets from various production systems. I'll conclude with a discussion of responsible disclosure practices in today's AI world, and how we might improve them.