# NVIDIA’s New Chip Delivers 30x More AI Work Per Watt

URL: https://technosports.co.in/nvidias-chip-delivers-30x-more-ai-work-per-watt/  
Published: 2026-08-25  
Updated: 2026-08-25  
Author: Raunak Saha

*NVIDIA’s new **Vera Rubin NVL72** is here:*AI agents don’t just chat — they research, code, and reason through dozens of steps before delivering an answer. That process burns through tokens fast, and NVIDIA’s newest data centre platform is built specifically to handle it. The **Vera Rubin NVL72** delivers up to **30x higher throughput per megawatt** than its predecessor, according to fresh performance data NVIDIA just published.

## Why Agentic AI Needs Different Infrastructure

Here’s the core problem NVIDIA is solving: according to OpenRouter data, agentic AI workloads consume **15x more tokens** than a simple chat request. Think about an AI agent researching a company for an investment call — it queries databases, searches filings, spins up sub-agents to run comparisons, then synthesizes everything into a recommendation.

Every step’s output becomes the next step’s input, so context keeps growing throughout the task. That makes handling massive, expanding context efficiently central to how well agentic AI actually performs at scale. For more on how AI infrastructure is evolving, check our [AI and technology coverage](https://technosports.co.in/category/technology/ai/).

![NVIDIA's New Chip Delivers 30x More AI Work Per Watt](https://technosports.co.in/wp-content/uploads/2026/08/end-to-end-social-chart1-agentx-activation-s2-1920x1080-1-1024x576.jpg)

## The Headline Numbers

| Metric | Vera Rubin NVL72 vs. GB300 NVL72 |
| --- | --- |
| Throughput per megawatt | Up to 30x higher |
| Cost per million tokens | Up to 35x lower |
| GPUs per megawatt budget | Up to 40% more (via DSX MaxLPS power management) |

NVIDIA measured these figures using **SemiAnalysis AgentX**, a benchmark built from recorded real-world agentic coding sessions — meaning actual context growth, tool calls, and sub-agent spawning, not a simplified synthetic test. The results are currently pending independent SemiAnalysis review.

![NVIDIA's New Chip Delivers 30x More AI Work Per Watt](https://technosports.co.in/wp-content/uploads/2026/08/end-to-end-social-chart1-agentx-activation-s1-1920x1080-1-1024x576.jpg)

## Why This Actually Matters for AI Companies

For data centres running on fixed power budgets, throughput per megawatt directly determines how much revenue an AI factory can generate, while cost per million tokens determines the profit margin on top of that revenue. A 30x efficiency jump isn’t just a benchmark bragging right — it’s the difference between running agentic AI profitably at scale or not.

## How NVIDIA Got There: Extreme Codesign

![NVIDIA's New Chip Delivers 30x More AI Work Per Watt](https://technosports.co.in/wp-content/uploads/2026/08/InferenceNeedsAgenticBenchmarks-scaled-1-1024x576.png)

Rather than one single breakthrough, Vera Rubin’s gains come from stacking multiple optimization techniques together across the entire platform:

- **Disaggregated serving** — separates context processing from response generation so each scales independently
- **Distributed KV-caching** — spreads memory across GPUs and offloads inactive context to storage, avoiding recomputation
- **Large-scale expert parallelism** — distributes sub-networks in mixture-of-experts models across the GPU cluster
- **NVFP4 quantization** — compresses model weights to 4-bit precision without sacrificing output quality

Underpinning all of this is sixth-generation **NVLink** interconnect technology, delivering 10x higher packet rates and 3x lower latency than standard Ethernet — critical for keeping GPUs talking to each other fast enough to make these techniques work at scale. Full technical details are available via [NVIDIA’s Vera Rubin platform page](https://blogs.nvidia.com/blog/vera-rubin/).

---

## What’s Next

Vera Rubin NVL72 is now in full production and scaling across NVIDIA’s partner ecosystem, with the company noting continuous software optimizations should push performance even higher over time. Keep following our [AI infrastructure coverage](https://technosports.co.in/category/technology/ai/) section as more real-world deployments and independent benchmarks emerge.