Introduction to Method of Steepest Descent - YouTube
Animations of Gradient Descent and Loss Landscapes of Neural Networks in Python | by Tobias Roeschl | Towards Data Science
David Li-Bland's Blog - Saddle Points and Stochastic Gradient Descent
optimization
David Li-Bland's Blog - Saddle Points and Stochastic Gradient Descent
Gabriel Peyré on X: "Gradient descent is inefficient to find saddle point (Nash equilibrium) for min-max games, because of spiralling behaviour. Beware when training your GANs … https://t.co/KKKGQ4q9JA https://t.co/xjgLuUHPMU https://t.co/hYYH0xWUXP" / X
Escaping from Saddle Points – Off the convex path
gradient descent - How can it be trapped in a saddle point? - Cross Validated
The journey of Gradient Descent — From Local to Global | by Pradyumna Yadav | Analytics Vidhya | Medium
Gradient Descent converging to a Saddle Point | Beni Bogoşel's blog
![4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]](https://www.oreilly.com/api/v2/epubs/9781491925607/files/assets/fodl_0405.png "4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]")
4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]
Escaping from Saddle Points – Off the convex path
How to Escape Saddle Points Efficiently – The Berkeley Artificial Intelligence Research Blog
Intro to optimization in deep learning: Momentum, RMSProp and Adam
Quantum algorithms for escaping from saddle points – Quantum
David Li-Bland's Blog - Saddle Points and Stochastic Gradient Descent
Frontiers | Noise Helps Optimization Escape From Saddle Points in the Synaptic Plasticity
optimization - Why does momentum escape from a saddle point in this famous image? - Cross Validated
Intro to optimization in deep learning: Gradient Descent
Intro to optimization in deep learning: Gradient Descent
Newton's method in optimization - Wikipedia
