The Linear Representation Hypothesis in Large Language Models: How Neural Geometry Organizes Concepts, Latent Truth, and Steerable Features
The Linear Representation Hypothesis in Large Language Models: How Neural Geometry Organizes Concepts, Latent Truth, and Steerable Features Deep neural networks are composed of alternating non-linear activation functions, multi-head attention operations, and high-dimensional matrix projections. Despite this architectural non-linearity, empirical research across mechanistic interpretability reveals a striking geometric regularity: within the intermediate representation spaces of large language m




