timeout budget
An operation’s total deadline must account for downstream calls, retries, and cleanup.
Use this when A user-facing request takes far longer than its intended maximum.
without the term
“One slow API call makes our page hang for 60 seconds because each layer has its own timeout and retries. Can you make the whole thing give up after 3 seconds?”
with the term · How do you ask a model for timeout budget?
Apply one timeout budget to this workflow. Test a slow dependency and bounded retries, ensuring leftover work is cancelled or safely handed off.
What is timeout budget?
The whole request gets one deadline, and each downstream call uses only what's left, retries included, so a 3-second request can't quietly take 30.
Why does timeout budget matter when vibe coding?
Each generated client wrapper may introduce its own full timeout and retry cycle.
How do you do timeout budget?
Propagate a remaining deadline and define safe cancellation and retry behavior.
What goes wrong with timeout budget?
Retrying a timed-out write without knowing whether its side effect already happened.