Autoscaling

A step of the Cloud application tree on Gradus, in the Serving & compute area: HTTP, workers, scaling.

Scale instances on real signals such as queue depth or request latency, with sane floors and ceilings.

Usually comes after: Container orchestration.

Prompt for your AI assistant

Configure horizontal autoscaling for the application deployment based on CPU and a custom metric such as queue depth or request latency, with minimum and maximum replica counts.

This is https://gradus.kazet.blog/tree/cloud-application/step/autoscaling as plain HTML. In a browser the page also lets you mark the step forged and copy a message for your AI assistant.