I am frequently asked, why does weightwatcher work ? The weightwatcher tool uses power law fits to model the eigenvalue … More
Tag: machine learning
WeightWatcher: Empirical Quality Metrics for Deep Neural Networks
We introduce the weightwatcher (ww) , a python tool for a python tool for computing quality metrics of trained, and … More
Heavy Tailed Self Regularization in Deep Neural Nets: 1 year of research
My talk at ICSI-the International Computer Science Institute at UC Berkeley. ICSI is a leading independent, nonprofit center for research … More
Foundations: The Partition Function.
We are going to examine the Partition function that arises in Deep Learning methods like Restricted Boltzmann Machines. We take … More
Music Recommendations and the Logistic Metric Embedding
In this post, we are going to see how to build our own music recommender, using the Logistic Metric Embedding … More
calculated | content 