I am frequently asked, why does weightwatcher work ? The weightwatcher tool uses power law fits to model the eigenvalue … More
Tag: Deep Learning
WeightWatcher: Empirical Quality Metrics for Deep Neural Networks
We introduce the weightwatcher (ww) , a python tool for a python tool for computing quality metrics of trained, and … More
Heavy Tailed Self Regularization in Deep Neural Nets: 1 year of research
My talk at ICSI-the International Computer Science Institute at UC Berkeley. ICSI is a leading independent, nonprofit center for research … More
Why Deep Learning Works II: the Renormalization Group
Deep Learning is amazing. But why is Deep Learning so successful? Is Deep Learning just old-school Neural Networks on modern … More
Why does Deep Learning work?
Why does Deep Learning work? This is the big question on everyone’s mind these days. C’mon we all know the … More
Foundations: The Partition Function.
We are going to examine the Partition function that arises in Deep Learning methods like Restricted Boltzmann Machines. We take … More
calculated | content 