Transformers
Explore recommended reads, summarized by AI
Alternative Architectures
Models that challenge or replace transformer designs.
Mamba and State Space Models
RNNs and LSTMs
Applications
Building systems and products with transformer models.
NLP Applications
RAG and LLM Applications
Architecture Fundamentals
Explanations of core transformer components and how the architecture works.
Architectural Overviews
Attention Is All You Need
Attention Mechanisms
Learning Transformer Basics
Positional Encoding
Tokens and Data Flow
Computer Vision
Applying transformers to image and visual tasks.
Vision Transformers
Implementation and Code
Practical guides to building and coding transformer models.
Building from Scratch
Using Hugging Face
Interpretability
Understanding what happens inside transformer models.
Mechanistic Interpretability
Model Variants
Specific transformer models and their distinguishing features.
BERT and Variants
Large Language Models
Optimization and Efficiency
Techniques for making transformers faster and more memory-efficient.
Fine-Tuning with LoRA and PEFT
KV Cache and Inference Speed
Time Series
Using transformers for forecasting and temporal data.
