double-descent

Here are 28 public repositories matching this topic...

MinghuiChen43 / awesome-deep-phenomena

A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

awesome-list empirical-research grokking emergence information-bottleneck-theory non-convex-optimization lottery-ticket-hypothesis deep-learning-theory neuroscience-inspired-ai phase-transitions double-descent neural-tangent-kernel neural-collapse

Updated Aug 18, 2026

RylanSchaeffer / Stanford-AI-Alignment-Double-Descent-Tutorial

Star

Code for Arxiv Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle

machine-learning deep-learning double-descent

Updated Nov 24, 2023
Python

csinva / mdl-complexity

Star

MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".

machine-learning statistics ai information-theory linear-regression artificial-intelligence model-selection complexity mdl ridge-regression linear-regression-models linear-models minimum-description-length bias-variance-tradeoff bias-variance-trade double-descent mean-squared-error

Updated Jun 12, 2023
Jupyter Notebook

josch14 / double-descent

Star

Double Descent results for FCNNs on MNIST, extended by Label Noise (Reconciling Modern Machine-Learning Practice and the Classical Bias–Variance Trade-Off) [Python/PyTorch]..

python pytorch mlp label-noise fully-connected-neural-network double-descent weight-reuse

Updated Oct 24, 2023
Python

antonior92 / narx-double-descent

Star

Explore the double-descent phenomena in the context of system identification. Companion code to the paper (https://arxiv.org/abs/2012 8000 .06341):

machine-learning system-identification narx double-descent

Updated Dec 14, 2020
Python

VGCQ / SDD_ViT

Star

[ICIAP23] Sparse Double Descent in Vision Transformers: real or phantom threat?

deep-learning pytorch double-descent

Updated Dec 17, 2024
Python

ZhangXiao96 / OptimizationVariance

Star

This repository is the official implementation of "Optimization Variance: Delve into the Epoch-Wise Double Descent of DNNs"

deep-learning optimization dnn variance generalization double-descent

Updated Sep 29, 2020
Python

tensor-fusion / Double-Descent-Deep-Nets

Star

Double descent experiments/repros on classical ML models and deep neural nets

machine-learning regression double-descent

Updated Apr 24, 2024
Jupyter Notebook

VGCQ / DSD2

Star

[AAAI24] DSD2: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free?

deep-learning pytorch double-descent

Updated Dec 17, 2024
Python

nplotko / double-descent-lr

Star

This project outlines 4 experiments to explore the effects of several settings on the bias-variance tradeoff curve

machine-learning gpu linear-regression regression double-descent overparameterization

Updated Sep 26, 2022
Jupyter Notebook

VictorZXY / dnn-assignments 8000

Star

Assignments of my CST Part II Deep Neural Networks unit

machine-learning deep-learning pytorch recurrent-neural-networks stochastic-gradient-descent adversarial-examples residual-neural-networks double-descent

Updated Dec 27, 2021
Jupyter Notebook

ShawnGeorge03 / STAD80-Review_Of_Double_Descent

Star

A Review of Preetum Nakkiran's "More Data Can Hurt for Linear Regression: Sample-wise Double Descent"

linear-regression double-descent

Updated Apr 15, 2023
TeX

sidak / double-descent

Star

ICLR 2022: Phenomenology of Double Descent in Finite-width Neural Networks

deep-learning neural-networks hessian generalization double-descent

Updated Mar 14, 2022

enlacroix / intuitive_learning

Star

Implementation of the double descent Deep Learning phenomenon from the article Grokking: Generalization beyond overfitting.

deep-learning double-descent

Updated Feb 18, 2024
Python

comitanigiacomo / double-descent-analysis

Star

Python empirical replication of the Double Descent risk curve in Machine Learning using from-scratch closed-form linear models.

python machine-learning linear-regression ridge-regression double-descent

Updated May 7, 2026
Jupyter Notebook

gianlucapasquinelli03-creator / Investigating-the-Double-Descent-Phenomenon

Star

Do sparse, one-class purchase data exhibit double descent? A study of NMF, weighted MF (iALS), and Logistic Matrix Factorization on real e-commerce transactions. Sapienza SML project.

machine-learning collaborative-filtering recommender-system double-descent

Updated Jul 13, 2026
Jupyter Notebook

RUI2190 / InterpretableDoubleDescent

Star

DSC 261 Responsible Data Science Project

mnist interpretable-machine-learning double-descent

Updated Mar 22, 2024
Python

fpgdubost / CIFAR-10-optimization

Star

Toy dataset to study double descent optimization patterns in machine learning.

machine-learning double-descent

Updated May 14, 2021
Python

Praaathaamesh / Deep_Double_Descent_Clinical_MLC

Star

This assignment repository demonstrates the existance of deep double descent phenomena for the deep learning models usually encorporated with a clinical context. For this, a famous ECG dataset, PTBXL has been employed.

machine-learning deep-learning python3 tensorboard-visualizations tensorflow2 double-descent artificail-intelligence