Skip to main content

Scaling

Controls replica count and autoscaling behavior for app environments.

Attributes​

AttributeTypeDescription
replicasUnion[int, Tuple[int, int]] = (0, 1)Number of replicas to run. Can be a single int or a tuple of two ints representing the min and max replicas.
metricOptional[Union[Concurrency, RequestRate]] = NoneMetric to use for autoscaling. Can be a concurrency or request rate.
scaledown_after`inttimedelta

Constructor​

Signature​

def Scaling(
replicas: Union[int, Tuple[int, int]] = (0, 1),
metric: Optional[Union[Concurrency, RequestRate]] = None,
scaledown_after: int | timedelta | None = None
) -> None

Parameters​

NameTypeDescription
replicasUnion[int, Tuple[int, int]] = (0, 1)Number of replicas. An int for fixed count, or a (min, max) tuple for autoscaling.
metricOptional[Union[Concurrency, RequestRate]] = NoneAutoscaling metric — Scaling.Concurrency(val) or Scaling.RequestRate(val).
scaledown_after`inttimedelta

Methods​


get_replicas()​

def get_replicas(self) -> Tuple[int, int]: ...

Retrieves the minimum and maximum replica bounds as a two-integer tuple.

Returns​

TypeDescription
Tuple[int, int]A tuple containing the minimum and maximum number of replicas.