2. Talking to a model well
Prompt caching
When every request starts with the same large block (company rulebook, style guide), the provider can remember that block instead of re-reading it each time — at a steep discount.
Why it matters: purely a cost trick, but a big one — often 90% off the repeated portion. For high-volume work it's the difference between affordable and not.
Bence K. Csernak
Founder
More in “Talking to a model well”