Micheal Bee·Aug 1The Wrong BasinWatching a language model fall into the attractor next door, and what a Hopfield view of transformers says to do about it
Eng Chong Yock·Jun 30Making Sense of Modern Hopfield Networks and AttentionReference. This derivation is based on Hopfield Networks is All You Need (Ramsauer et al., 2020)
Outermostkt·May 31What Is the Relationship Between Thermodynamics and Information Technology, Including AI?What Is the Relationship Between Thermodynamics and Information Technology, Including AI? — I Asked an AI (Claude)
Outermostkt·May 26Try It Yourself: A Demo App of the Technology That Sparked the Rise of AI!—misc/nobel at main · GitGhidorah/misc
Eleventh Hour Enthusiast·Apr 19Attention Is Hopfield RetrievalAssociative memory in continuous state space and its connection to attention in transformers
