Skip to main content

Transformer links

, 1 min read

Interactive tools and references for seeing how transformer models work inside.

Transformer Explainer​

An interactive tool for visualizing and understanding the inner workings of transformer models. It shows how these models process and generate text across layers and attention heads.

Open Transformer Explainer

LLM Visualization​

A visualization platform with detailed, intuitive explorations of large language models (LLMs). It helps you build a deeper understanding of their structure, parameters and behavior.

Open LLM Visualization

Transformer Circuits​

A comprehensive resource on the circuit-level functioning of transformer models. It focuses on frameworks and simplifications that demystify their decision-making processes and internal representations.

Open A Mathematical Framework for Transformer Circuits