Notes

Short expository notes and journal-club summaries.

Robust agents learn causal world models

A summary of Richens and Everitt (ICLR 2024): an agent that stays near-optimal across intervention-induced domain shifts must, in an information-theoretic sense, carry an approximate causal model of its environment. PDF

Preconditioned DeltaNet: a curvature and online-regression view

Notes on Tumma, Loo, and Rus, Preconditioned DeltaNet: curvature-aware sequence modeling for linear recurrences (arXiv:2604.21100). The delta rule is online first-order regression on the recurrent state, and preconditioning makes that regression curvature-aware. PDF