Transformers, the tech behind LLMs | Deep Learning Chapter 5

Why it was recommended

what bade me finally understand the transformer architecture [0] and attention [1], are 3Blue1Brown's videos.

Strong recommendationtomashm · Original2024-07

What it covers

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention. It is for someone meeting the subject for the first time.

Video details

Channel

3Blue1Brown

Length

27 min 14 sec

Year

2024

More in this topic

• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4
• Let's build the GPT Tokenizer