Skip to main content
Fine-Tuning & Cost Optimization

Prompt Caching

  • Updated
  • By the Groovy Web team
  • 2 min read

What is Prompt Caching?

An LLM API feature that caches static parts of a prompt (system instructions, long context) so repeat requests skip re-processing those tokens, cutting cost and latency.

Prompt Caching explained

Major LLM providers offer prompt caching, and the pricing rules differ. On Anthropic's API, reading a cached prefix costs 0.1 times the base input price (some newer models are lower), while writing to the cache costs 1.25 times the base price for a 5-minute cache and 2 times for a 1-hour cache (Anthropic prompt caching documentation). Check each provider's current rules before you plan savings. Useful for chatbots with long system prompts, RAG apps with stable retrieved context, and agents that loop over the same tool definitions.

How Groovy Web uses Prompt Caching

We turn on prompt caching in production agent and RAG systems where a long prompt prefix is reused. Savings depend on how much of each request repeats, so we measure them per system.

Explore our AI Infrastructure Optimization service →

Prompt Caching: common questions

What is Prompt Caching?

An LLM API feature that caches static parts of a prompt (system instructions, long context) so repeat requests skip re-processing those tokens, cutting cost and latency.

What should I know about Prompt Caching?

Major LLM providers offer prompt caching, and the pricing rules differ. On Anthropic's API, reading a cached prefix costs 0.1 times the base input price (some newer models are lower), while writing to the cache costs 1.25 times the base price for a 5-minute cache and 2 times for a 1-hour cache (Anthropic prompt caching documentation).

How does Groovy Web use Prompt Caching?

We turn on prompt caching in production agent and RAG systems where a long prompt prefix is reused. Savings depend on how much of each request repeats, so we measure them per system.

Which terms are related to Prompt Caching?

Prompt Caching is closely related to Context Window, Inference, Token (AI/LLM) and Retrieval-Augmented Generation (RAG).

Related terms

← More in Fine-Tuning & Cost Optimization  ·  All 107 glossary terms

Start a Project

Got an Idea?
Let's Build It Together

Tell us about your project and we'll get back to you within 24 hours with a game plan.

Schedule a Call Book a Free Strategy Call
30 min, no commitment
Response Time

Mon-Fri, 8AM-12PM EST

4hr overlap with US Eastern
500+ Projects Delivered
18+ Years Experience
4 Countries

Follow Us

1-week risk-free trial, keep the code

Hire an AI-First Engineering Team
Production-Grade. Your US Hours.

For startups & product teams

One senior engineer, AI-accelerated. Owns architecture, security, and the last 20% AI tools leave broken. No recruitment, no ramp-up.

Trusted by 200+ startups worldwide

Production-grade delivery
4hr live US overlap
Start in 48 hours

No long-term commitment · 100% IP yours · Cancel anytime