What to watch
Raise the load and capacity does not follow. The controller waits out three seconds of cooldown, decides, and the new machines take four more to boot. Requests fail in that gap, and the gap is the point: an autoscaler lags, it does not shield.What it is made of
Under load
Measured by running this design through the simulator at multiples of its own offered rate of 250 requests a second. Twenty seconds of simulated time, one fixed seed, so the same numbers come out every time.This design holds 625 requests a second with 0% errors. At 750 it is losing 18% of them.
Open this example
Load Autoscaling service from the Examples menu and drag the traffic slider yourself.