Probing whether induction head universality is truly architecture-agnostic or whether model family leaves a structural fingerprint on the circuits that enable in-context learning.
-
Updated
Jul 6, 2026 - Python
Probing whether induction head universality is truly architecture-agnostic or whether model family leaves a structural fingerprint on the circuits that enable in-context learning.
Probing where in Pythia's residual stream the decision to be sycophantic is already 'decided', using linear classifiers on per-layer activations against a small labeled sycophancy dataset.
A hypothesis of depth-indexed state regimes in pre-RMSNorm language models.
To associate your repository with the interpretability-experiments topic, visit your repo's landing page and select "manage topics."