Prompt Caching

5 stories tagged Prompt Caching.

How Prompt Caching Cuts AI Agent Costs

Prompt caching can dramatically reduce AI agent costs—but only if your setup preserves reusable prefixes. Here's what actually gets cached and what kills it.

OpenAI Build Hours presentation slide on valuemaxxing with GPT-5.6, featuring a speaker portrait on a gradient…

GPT-5.6 and the Shift from Token Spend to Output Value

Dev Kapoor2 weeks ago

AI. Dev Kapoor2 weeks ago

GPT-5.6 and the Shift from Token Spend to Output Value

OpenAI's Build Hour on GPT-5.6 makes a case for measuring AI by outcomes, not tokens. Here's what that actually means in production.

CAG vs Long Context: How LLMs Access External Data

Marcus Chen-Ramirez3 months ago

AI. Marcus Chen-Ramirez3 months ago

CAG vs Long Context: How LLMs Access External Data

Long context and Cache Augmented Generation solve the same problem differently. Here's what that means for AI costs, speed, and when to use which approach.

Person pointing at Claude interface displaying 93 million tokens saved, demonstrating increased usage capacity

Prompt Caching: The Reason Claude Code Doesn't Eat Your Limits

Yuki Okonkwo3 months ago

AI. Yuki Okonkwo3 months ago

Prompt Caching: The Reason Claude Code Doesn't Eat Your Limits

Prompt caching saves Claude Code users millions of tokens automatically—but a few small habits (and one surprising setting) can silently undo all of it.

Man in dark shirt gesturing while explaining prompt caching concepts on a whiteboard with handwritten notes about…

Prompt Caching: Making AI Actually Cheaper and Faster

Tyler Nakamura6 months ago

AI. Tyler Nakamura6 months ago

Prompt Caching: Making AI Actually Cheaper and Faster

IBM's Martin Keen explains prompt caching—the technique that's cutting AI costs by storing key-value pairs instead of reprocessing the same prompts.