CILVR SEMINAR: Deep learning from an information theory perspective

Date: Wednesday, November 17, 2021, 8PM

Location: ONLI

Speaker: Ravid Shwartz-Ziv

While DNNs have achieved many breakthroughs, our understanding of their internal structure, optimization process, and generalization is poor, and we often treat them as black boxes. We attempt to resolve these issues by suggesting that DNNs learn to optimize the Information Bottleneck (IB) principle - the tradeoff between information compression and prediction quality.