Frontier Technology Portal Independent technology analysis / Updated daily
Frontier Technology Portal logo
FRONTIER Technology Portal for the next wave of invention

Frontier Technology News, Analysis and Reviews

The Frontier Briefing Signals from AI, machines, space, biology, energy and security
How Speculative Decoding Speeds Up AI Text Generation
Artificial Intelligence

How Speculative Decoding Speeds Up AI Text Generation

A small model can draft several tokens for a larger model to verify together. Here is how speculative decoding works, why it does not check facts, and when its speed advantage can disappear.

Long AI Context Windows Have a Memory Bill
Artificial Intelligence

Long AI Context Windows Have a Memory Bill

Long AI prompts consume temporary memory through the KV cache, so context length affects latency, throughput, concurrency, and serving cost even when model weights stay fixed.

The Frontier Briefing

Get a concise weekly briefing on the technologies moving from research into the real world.

Join the briefing