Benchmark Llama 3 8B against Mistral 7B v0.3 on MMLU scores

You're standing up a new fine-tuning pipeline, you've got a single A100 reserved for the weekend, and you need to pick between Llama 3 8B and Mistral 7B v0.3 as your base model. The MMLU leaderboard puts Llama 3 8B at 82.0%.

June 29, 2026 · 8 min read