PickVidsGradIEEEnt half decent: The hidden power of imprecise lines
Why it was recommended
A fun example of that (making a neural network using floating point error as a source of non-linearity)
Recommendationjcparkyn · Original
What it covers
Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity. It is for someone who wants the derivation, proof, or implementation detail.
Video details
- Channel
- suckerpinch
- Length
- 55 min 2 sec
- Year
- 2023
More in this topic
- The spelled-out intro to neural networks and backpropagation: building micrograd
- But what is a neural network? | Deep learning chapter 1
- AlphaGo - The Movie | Full award-winning documentary
- Transformers, the tech behind LLMs | Deep Learning Chapter 5
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
- Lecture 1 | Machine Learning (Stanford)