AI Glossary
MMLU (Massive Multitask Language Understanding)
What is MMLU (Massive Multitask Language Understanding)?
A widely used benchmark that tests language model performance across 57 academic subjects including law, medicine, history, and mathematics. MMLU scores are commonly cited in model comparisons and press releases. Like all benchmarks, high MMLU scores correlate with but do not guarantee real-world task performance.
Example in practice
A technology buyer who sees a vendor claim "95% MMLU score" should note that this measures broad academic knowledge across 57 subjects — not necessarily performance on the specific professional tasks they care about.
Learn more
See MMLU (Massive Multitask Language Understanding) applied in a professional context through this free course.
AI Fundamentals for Professionals →