Best Information theory & signal processing Videos
「Information theory & signal processing」下面有43部被不同的人、在不同月份推荐过的视频。挑的时候先看对象:入门11部,适合还没学过的人;进阶12部,适合已经懂术语的人;普通向17部,按兴趣就能看;更硬的3部,留给想看推导或细节的人。这一类数量最多的是讲解,所以它们的共同点是用一个图像或类比把一个概念补上。常出现的频道包括3Blue1Brown、Computerphile、Veritasium。目录给这个主题划的范围是:Information theory and signals: entropy, Claude Shannon, compression, error-correcting codes, Fourier transform, signal processing, sampling, digital audio and video theory.如果只看三部,就从《But what is the Fourier Transform? A visual introduction.》开始,它负责把问题讲出画面;然后看《D/A and A/D | Digital Show and Tell (Monty Montgomery @ xiph.org)》,换一种讲法或例子;最后看《The Fast Fourier Transform (FFT): Most Ingenious Algorithm Ever?》,留给已经有基础的人。页面按每页24部切开,顺序看的是被推荐跨越了多少个月,不是播放量。每条标题下面那一句是这部片子自己的内容说明,用来区分它在讲定义、过程、演示还是观点。点进去能看到推荐原话、原文链接和适合谁看。看的时候把强烈推荐当成有人明确叫你去看,把引用当成只是拿来举例,把批评留下来对照,不要把每条评论都当成同一力度。

Solving Wordle using information theory
3Blue1Brown uses Wordle as an excuse to teach information theory and entropy, building a solver that picks guesses by expected information and incorporating word frequencies.

Hold music used to sound better. Here's why.
Tom Scott explains why hold music sounds worse than it used to, tracing it to old telephone exchanges and the audio compression applied by modern switches.

Samplerates: The Higher the Better, Right?
Dan Worrall explains when higher sample rates help in recording and mixing, and when they do not.

Succinct Data Structures
Edward Kmett's 2013 talk at Prezi in Budapest on succinct data structures, which store data in close to the information-theoretic minimum space while supporting fast queries.

Marcus Hutter: Universal Artificial Intelligence, AIXI, and AGI | Lex Fridman Podcast #75
Lex Fridman interviews Marcus Hutter of DeepMind about universal artificial intelligence, AIXI, Kolmogorov complexity, Solomonoff induction and the idea of intelligence as compression.

The Visual Microphone: Passive Recovery of Sound from Video
MIT researchers show that sound can be recovered from silent video by analyzing tiny vibrations in objects such as a potato chip bag.

Progressive decoding: JPEG vs JPEG XL vs AVIF
A short side-by-side demo of a large image loading over a slow connection in JPEG, progressive mozjpeg, JPEG XL and AVIF.

Is Starlink A Secret Radar Constellation?
A 105-minute technical deep dive from Noise In Space evaluating whether Starlink satellites could work as synthetic aperture radar.

I published music on Tidal to test MQA - MQA Review
GoldenSound publishes music on Tidal to test MQA, a deep dive into the format's claims and problems including its leaky filter.

Epicycles, complex Fourier series and Homer Simpson's orbit
Mathologer explains epicycles and complex Fourier series, inspired by an animation of Homer Simpson drawn with epicycles.

Dial Up Modem Handshake Sound - Spectrogram
A spectrogram visualization of the sounds in a dial-up modem handshake, with an annotated image explaining each noise.

I built a QR code with my bare hands to see how it works
Veritasium builds a QR code by hand to explain how it works.

An Observation on Generalization
Ilya Sutskever gives a Simons Institute talk on why neural networks generalize, framing learning as finding short descriptions, like compression.

Venetian Snares - Look (from Songs About My Cats 2001)
A short clip of Venetian Snares' track 'Look' from Songs About My Cats (2001), shown as a spectrogram.

[Equation] - Aphex Twin Spectrogram
A spectrogram analysis of Aphex Twin's track commonly called [Equation] from Windowlicker, rendered from a lossless version.

Do I look like I know what a JPEG is?
A King of the Hill clip in which Hank-style character rants about saving images as PNG instead of JPEG after exporting from Windows Paint.

VIDEO ROOM 1000 COMPLETE MIX -- All 1000 videos seen in sequential order!
A condensed rendition of a project that re-uploaded one video to YouTube 1000 times, showing the accumulating compression artifacts.

RTTY DEMO 012710.wmv
A short demonstration of radioteletype (RTTY), a digital communication mode used in amateur radio, showing what the signal sounds like.

Adobe MAX 2011 - Photoshop Image Deblurring sneak
A six-minute clip of Adobe's MAX 2011 sneak peek showing a Photoshop prototype that removes motion blur from photos.