Skip to main content
Deliberate AcademyProfessional AI Education
AI Glossary

Transformer

What is Transformer?

The neural network architecture that underlies virtually all modern LLMs. Introduced in the 2017 paper "Attention Is All You Need". Processes entire input sequences in parallel using attention mechanisms, enabling training on far larger datasets than previous sequential architectures.

Example in practice

Every major language model — GPT-4, Claude, Gemini — is a transformer: a professional using any of these tools is interacting with the same foundational architecture developed in a single 2017 paper.

Learn more

See Transformer applied in a professional context through this free course.

AI Fundamentals for Professionals