Deep Neural Networks (DNN) require a lot of training data. Even fine-tuning a model can require a lot. A LOT. So how can you know
is your model overtrained ?
Are your models over-trained ? The weightwatcher tool can detect the signatures of overtraining in specific layers of a pre/trained Deep Neural Networks. In the
Simpson’s Paradox and Deep Learning Metrics with Weightwatcher
What is WeightWatcher ? The WeightWatcher tool is an open-source python package that can be used to predict the test accuracy of a series similar
Why WeightWatcher Works
I am frequently asked, why does weightwatcher work ? The weightwatcher tool uses power law fits to model the eigenvalue density of weight matrices of
WeightWatcher: Empirical Quality Metrics for Deep Neural Networks
We introduce the weightwatcher (ww) , a python tool for a python tool for computing quality metrics of trained, and pretrained, Deep Neural Netwworks. pip
Towards a new Theory of Learning: Statistical Mechanics of Deep Neural Networks
Introduction For the past year or two, we have talked a lot about how we can understand the properties of Deep Neural Networks by examining
