Remembering an answer so the same question next time is instant and free, with an agreed shelf life (TTL — time to live) before it's fetched fresh.
Why it matters: the first economy lever of AI operations: identical questions shouldn't be paid for twice. The trade is staleness — cached answers are yesterday's answers, so the shelf life is a business decision.
More in “Keeping it running in the real world”