LLM inference latency: what the benchmark data shows
In production LLM inference deployments, the gap between a model's theoretical throughput and its measured tokens-per-second (TPS) routinely exceeds 3x. The discrepancy is not a function of model quality.

NewsLIVE
Researchers build missing infrastructure to move AI between robots
Krafton Presents 20 Papers at ICML 2026, Including Record 10 Main Track Submissions
Machine Learning for Life Scientists: A Practical Methods Guide
New AI Tool Maps Urban Tree Canopy Using Aerial Imagery
LG's Exaone AI Discovers New Hair Loss Material in a Day, Showcases Industrial Breakthroughs at ICML 2026
July AI Office Hours and workshops support practical learning, research and exploration
OpenAI to Publicly Launch GPT-5.6 Model Series on July 9
The feed
Code & Implementations
Hugging Face Transformers Library: Performance in Numbers
Models & Benchmarks
Stable Diffusion Models: How to Calculate FID and CLIP Scores
Models & Benchmarks
Benchmark Llama 3 8B against Mistral 7B v0.3 on MMLU scores
How Open Models Are Driving AI Research
How to use artificial intelligence to strengthen scientific processes and scholarly output
Code & Implementations
Profile PyTorch Memory Across Batch Sizes: A Tutorial
Anthropic unveils 'Claude Science' for scientific research
Beyond GPUs? Researchers Propose New Computing Architecture to Cut AI Energy Use
What is Mistral AI? Everything to know about the OpenAI competitor
The only AI glossary you’ll need this year
International Conference on Machine Learning (ICML) 2026
From Flickering to Flawless: Scientists Map the Future of AI-Powered Face Video Restoration | Newswise
CoreWeave Unveils ARIA to Accelerate AI Research and Agent Development
Senator Budd Urges CAISI to Restore Frontier AI Research
OpenAI Staggers AI Model Release After Trump Administration Request
AI Research Trends, H1 2026: What 170,927 Papers Reveal
Short Course: AI Applications Using Environmental Satellite Remote Sensing Data
SCBX Advances Frontier Research Capabilities Five AI Papers Accepted Across Four Leading Global Conferences
Moving artificial intelligence from research to real-world clinical use in neurology
Google Cloud to Offer Specialist AI Models for Science Research
MLOps & Infrastructure
Cut Kubernetes cold start times for serverless LLMs
Datasets & Curation
Calculate MinHash Duplicate Ratio in Pretraining Data
Research & Architectures