The pre-agreed plan B: if the main model or provider fails or is overloaded, requests automatically go to a backup. Also used for answers: if the AI isn't confident, fall back to a safe response or a human.
Why it matters: providers do go down. A system with no fallback is a system with scheduled outages you didn't schedule.
More in “Talking to a model well”