How might LLMs store facts | Chapter 7, Deep Learning

Unpacking the multilayer perceptrons in a transformer, and how they may store facts Instead of sponsored ad reads, these lessons are funded directly by viewers: An equally valuable form of support is to share the videos. AI Alignment forum post from the Deepmind researchers referenced at the video’s start: Anthropic posts about superposition referenced near the end: Some added resources for those interested in learning more about mechanistic interpretability, offered by Neel Nanda Mechanistic interpretability paper reading list https ... #3Blue1Brown #Mathematics #three_blue_one_brown #3_blue_1_brown #3b1b #3brown1blue #3_brown_1_blue #three_brown_one_blue 20240831 9-Jl0dxWQs8