← Dictionary

2. Talking to a model well

Prompt caching

When every request starts with the same large block (company rulebook, style guide), the provider can remember that block instead of re-reading it each time — at a steep discount.

Why it matters: purely a cost trick, but a big one — often 90% off the repeated portion. For high-volume work it's the difference between affordable and not.