AI can't cross this line and we don't know why.
Why it was recommended
see eg for a well made/easily digestable intro
Recommendationkla-s · Original
What it covers
A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal. It is for someone who already knows the basic terms and wants the next step.
Video details
- Channel
- Welch Labs
- Length
- 24 min 7 sec
- Year
- 2024
More in this topic
- The spelled-out intro to neural networks and backpropagation: building micrograd
- But what is a neural network? | Deep learning chapter 1
- AlphaGo - The Movie | Full award-winning documentary
- Transformers, the tech behind LLMs | Deep Learning Chapter 5
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
- Lecture 1 | Machine Learning (Stanford)