Autoscaling
A step of the Cloud application tree on Gradus, in the Serving & compute area: HTTP, workers, scaling.
Scale instances on real signals such as queue depth or request latency, with sane floors and ceilings.
Usually comes after: Container orchestration.
Prompt for your AI assistant
Configure horizontal autoscaling for the application deployment based on CPU and a custom metric such as queue depth or request latency, with minimum and maximum replica counts.This is https://gradus.kazet.blog/tree/cloud-application/step/autoscaling as plain HTML. In a browser the page also lets you mark the step forged and copy a message for your AI assistant.