
NVIDIA Nemotron. Lightning-fast on PrimaLabs.
Over 500 tokens per second. PrimaLabs ranks #1 for output speed on both Nemotron Super VL and Lightning in Artificial Analysis’s 10k-input benchmarks, as of October 22, 2026.
Read6 minPrimaLabs ranks #1 on Artificial Analysis for NVIDIA Nemotron Super VL and Lightning Read the announcement
PrimaLabs ranks #1 on Artificial Analysis for MiMo-V2.6-Pro Read the announcement
Application-specific adaptive inference
PrimaLabs builds and operates a dedicated inference stack around each workload. Open models, served on sovereign terms, tuned continuously in production. National lab grade adaptive AI, now for enterprise.
Live request traffic arrives in the rhythm of the selected workload, enters a circuit built from the PrimaLabs dot-trace mark, and leaves as a single, steady, optimized stream. Selecting a workload above changes the arriving traffic pattern and the circuit adapts around it.
Why PrimaLabs
Slide 1 of 2
Why it compounds
The stack watches real traffic, learns what this specific workload needs, and ships an improvement only when it measures faster with identical outputs. Generic endpoints are tuned once. This one never stops.
Reads the live workload in real time, so every decision comes from real traffic, not a synthetic test.
Carries every win forward. The stack gets faster with use, without ever retaining the data it learns from.
Ships changes under the SLA, without touching the model or the product. Nothing reaches production on a hunch.
Generic endpoint
Flat. Tuned once, then frozen
PrimaLabs custom stack
Compounds. The stack learns the workload and improves with volume
Built for AI-native workloads
Agents fire thousands of near-identical requests in tight loops. The stack is built to answer them instantly, so the agent feels native, not throttled.
Multi-step agents chain tool calls, plans, and long contexts. The stack keeps every step fast and reuses what the workload repeats, so the whole chain finishes sooner.
When the model is the product, model speed is the product experience. The stack holds interactive latency through bursts and scale.
Proof
The workload runs on the current provider and on the PrimaLabs stack, side by side. Throughput, latency, and cost are measured and put in writing before any commitment. Lower cost is what the numbers produce.
Head-to-head evaluation
Measured on the customer workload
For two decades, the national labs perfected one discipline: extracting maximum useful work from fixed hardware under hard power and thermal limits. That is exactly the problem token cost now faces. PrimaLabs is that discipline applied, by the team behind ORBIT and the largest AI models ever trained on Frontier, the world's first exascale supercomputer.
Benchmarks, partnerships, and inference engineering notes from the PrimaLabs team.
Book a demo
Share the workload profile: traffic shape, models in use, latency target, and deployment constraints. PrimaLabs runs the head-to-head and returns the numbers.