Update
Towards Monosemanticity: Decomposing Language Models With Dictionary Learning
Anthropic posted “Towards Monosemanticity: Decomposing Language Models With Dictionary Learning.” A quick update for the record.
Quick note: Anthropic posted “Towards Monosemanticity: Decomposing Language Models With Dictionary Learning.” Logging it now. Context can come later if this turns into something bigger.