Information Theory

Explore recommended reads, summarized by AI

Foundations and Concepts

Explanations of core information theory principles including entropy, Shannon information, and surprise.

Entropy and Shannon Information

Theoretical Frameworks

Original theories connecting information principles to consciousness, quantum mechanics, and physical systems.

Information-Based Models of Physics and Consciousness

Popular this week

Science Spectrum

The armchair quantum physicist

Why Isn’t Nature More Quantum?

Oct 22

Starts With A Bang!

Ethan Siegel

The information paradox at the heart of every black hole

Sep 23

Mathcube

The Shannon Limit, and the Codes Nobody Could Find

Sep 28

Dhiraj Salian

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

4d ago

Data And Beyond

Dima Iakubovskyi

A Feature With Zero Correlation Predicted My Target Perfectly

Jul 30

Selected by Medium

Science Spectrum

The armchair quantum physicist

Why Isn’t Nature More Quantum?

Oct 22

Mathcube

The Shannon Limit, and the Codes Nobody Could Find

Sep 28

Starts With A Bang!

Ethan Siegel

The information paradox at the heart of every black hole

Sep 23

Science Spectrum

The armchair quantum physicist

The Best Bit Alice Can Send

Aug 10

The Quantastic Journal

Marco Capriz

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

May 19

Latest stories

Dhiraj Salian

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

4d ago

Balazs Otto Holczmann

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

4d ago

Maneaditya

What If We Transmitted Data Through DNA-Like Radio Waves? The Future of Double-Helix Communication

4d ago

R. F. NÖRIS

What Does It Cost a Cell to Read Its Code Well?

6d ago

Information Theory

Foundations and Concepts

Entropy and Shannon Information

Theoretical Frameworks

Information-Based Models of Physics and Consciousness

Popular this week

Why Isn’t Nature More Quantum?

The information paradox at the heart of every black hole

The Shannon Limit, and the Codes Nobody Could Find

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

A Feature With Zero Correlation Predicted My Target Perfectly

Selected by Medium

Why Isn’t Nature More Quantum?

The Shannon Limit, and the Codes Nobody Could Find

The information paradox at the heart of every black hole

The Best Bit Alice Can Send

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

Latest stories

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

What If We Transmitted Data Through DNA-Like Radio Waves? The Future of Double-Helix Communication

What Does It Cost a Cell to Read Its Code Well?

THE UNIVERSAL MOTHERFIELD THEORY VOLUME III: Chapter 9.5:

Who to follow

Popular this week

Why Isn’t Nature More Quantum?

The information paradox at the heart of every black hole

The Shannon Limit, and the Codes Nobody Could Find

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

A Feature With Zero Correlation Predicted My Target Perfectly

Selected by Medium

Why Isn’t Nature More Quantum?

The Shannon Limit, and the Codes Nobody Could Find

The information paradox at the heart of every black hole

The Best Bit Alice Can Send

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

Latest stories

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

What If We Transmitted Data Through DNA-Like Radio Waves? The Future of Double-Helix Communication

What Does It Cost a Cell to Read Its Code Well?

THE UNIVERSAL MOTHERFIELD THEORY VOLUME III: Chapter 9.5:

Who to follow