A Visual Introduction to Information Theory
(bookmark it)
Information Theory is such an beautiful and powerful subject.
In the era of AI, it's worth spending time learning about it.
Here is a highly-recommended read for anyone who wants real intuition for entropy and mutual information.
It's a visual, intuition-first guide to information theory.
It assumes only familiarity with basic probability, so it stays accessible while still reaching the fundamental limits of compression and transmission.
Paper: arxiv.org/abs/2206.07867
Learn to build effective AI agents in our academy: academy.dair.ai/
Yu Fu retweeted
Very excited to share our new preprint: “Thermal fluctuations set fundamental limits on ion channel function”, with @machtagroup. We ask: how does the need to overcome noise limit the function of ion channels?
arxiv.org/abs/2604.03538
Yu Fu retweeted
Out now on the arxiv is work with Jose, Matt, Thierry & Ben at @QbioYale. We show emergent discreteness in behaviour, for the first time, by asking for the best navigation strategy with a given information budget:
Very excited to share our new preprint: “Discrete turn strategies emerge in information-limited navigation”. This is joint work with @MattLeighton5, @EmonetLab, @machtagroup and @m_abski. We ask: why do small organisms have such interesting swimming strategies? (video: Berg lab)








