Figure 2 | Scientific Reports

Figure 2

From: Neuronal diversity can improve machine learning for physics and beyond

Figure 2The alternative text for this image may have been generated using AI.

Schematic stochastic gradient descent meta-learning nested loops. Neural-network weights and biases \(\theta\) adjust to lower losses \({\mathscr {L}}(\theta ,\theta _s)\), during an inner loop, while periodically the sub-network weights \(\theta _s\) open extra dimensions and themselves adjust to allow even lower losses, during an outer loop. Rainbow colors code time t.

Back to article page