AI has taken the world by storm. With recent advances like AlphaFold, Stable Diffusion, and ChatGPT, Deep Neural Networks (DNNs) … More
Category: Uncategorized
Better than BERT: Pick your best model
Have you ever had to sort through HuggingFace to find your best model ? There are over 54,000 models on … More
Is your layer over-fit? (part 2)
Say you are training a Deep Neural Network (DNN), and you see your model is over-trained. Or just not performing … More
Fantastic Measures of Generalization — That Actually Work
In the next few posts, I am going to discuss how to use the generalization metrics included in the open-source … More
Model Monitoring with WeightWatcher: Data-Free DEEP LEARNING Diagnostics
Weighwatcher is an open-source Model Monitoring tool that provides Data-Free Diagnostics for production-quality Deep Neural Networks (DNNs). It. can tell … More
How to tell if you have trained your Model with enough data ?
Deep Neural Networks (DNN) require a lot of training data. Even fine-tuning a model can require a lot. A LOT. … More
is your model overtrained ?
Are your models over-trained ? The weightwatcher tool can detect the signatures of overtraining in specific layers of a pre/trained … More
Simpson’s Paradox and Deep Learning Metrics with Weightwatcher
What is WeightWatcher ? The WeightWatcher tool is an open-source python package that can be used to predict the test … More
Why WeightWatcher Works
I am frequently asked, why does weightwatcher work ? The weightwatcher tool uses power law fits to model the eigenvalue … More
WeightWatcher: Empirical Quality Metrics for Deep Neural Networks
We introduce the weightwatcher (ww) , a python tool for a python tool for computing quality metrics of trained, and … More