Hugging Face's logo
tim-lawson 's Collections
Learning to Skip the Middle Layers of Transformers
Multi-Layer SAEs
Multi-Layer SAEs with Tuned Lens
Multi-Layer SAEs with Transformers
Multi-Layer SAEs with Tuned Lens and Transformers
Single-Layer SAEs
Single-Layer SAEs with Transformers

Multi-Layer SAEs with Transformers

Single SAEs trained on the residual stream activation vectors from every transformer layer simultaneously, including the transformers.

Upvote
-