Overload Manager

    As of Envoy v1.18 the v2 API has been removed and is no longer supported.

    If you are upgrading from v2 API config you may wish to view the v2 API documentation:

    The Overload Manager provides an extensible framework to protect Envoy instances from overload of various resources (memory, cpu, file descriptors, etc). It monitors a configurable set of resources and notifies registered listeners when triggers related to those resources fire.

    [config.overload.v3.ResourceMonitor proto]

    name

    (, REQUIRED) The name of the resource monitor to instantiate. Must match a registered resource monitor type. See the extensions listed in typed_config below for the default list of available resource monitor.

    typed_config

    () Configuration for the resource monitor being instantiated.

    Tip

    This extension category has the following known extensions:

    config.overload.v3.ThresholdTrigger

    [config.overload.v3.ThresholdTrigger proto]

    2.   "value": "..."
    3. }

    value

    () If the resource pressure is greater than or equal to this value, the trigger will enter saturation.

    config.overload.v3.ScaledTrigger

    1. {
    2.   "scaling_threshold": "...",
    3.   "saturation_threshold": "..."
    4. }

    scaling_threshold

    (double) If the resource pressure is greater than this value, the trigger will be in the state with value (pressure - scaling_threshold) / (saturation_threshold - scaling_threshold).

    saturation_threshold

    (double) If the resource pressure is greater than this value, the trigger will enter saturation.

    name

    (string, REQUIRED) The name of the resource this is a trigger for.

    ()

    Precisely one of threshold, must be set.

    scaled

    (config.overload.v3.ScaledTrigger)

    Precisely one of , scaled must be set.

    config.overload.v3.ScaleTimersOverloadActionConfig

    [config.overload.v3.ScaleTimersOverloadActionConfig proto]

    Typed configuration for the “envoy.overload_actions.reduce_timeouts” action. See for an example of how to configure the action with different timeouts and minimum values.

    1. {
    3. }

    timer_scale_factors

    (repeated config.overload.v3.ScaleTimersOverloadActionConfig.ScaleTimer, REQUIRED) A set of timer scaling rules to be applied.

    config.overload.v3.ScaleTimersOverloadActionConfig.ScaleTimer

    [config.overload.v3.ScaleTimersOverloadActionConfig.ScaleTimer proto]

    1. {
    2.   "min_timeout": "{...}",
    3.   "min_scale": "{...}"
    4. }

    timer

    () The type of timer this minimum applies to.

    min_timeout

    (Duration) Sets the minimum duration as an absolute value.

    Precisely one of , min_scale must be set.

    min_scale

    () Sets the minimum duration as a percentage of the maximum value.

    Precisely one of min_timeout, must be set.

    [config.overload.v3.ScaleTimersOverloadActionConfig.TimerType proto]

    UNSPECIFIED

    (DEFAULT) ⁣Unsupported value; users must explicitly specify the timer they want scaled.

    HTTP_DOWNSTREAM_CONNECTION_IDLE

    ⁣Adjusts the idle timer for downstream HTTP connections that takes effect when there are no active streams. This affects the value of

    HTTP_DOWNSTREAM_STREAM_IDLE

    TRANSPORT_SOCKET_CONNECT

    ⁣Adjusts the timer for how long downstream clients have to finish transport-level negotiations before the connection is closed. This affects the value of FilterChain.transport_socket_connect_timeout.

    config.overload.v3.OverloadAction

    [config.overload.v3.OverloadAction proto]

    name

    (, REQUIRED) The name of the overload action. This is just a well-known string that listeners can use for registering callbacks. Custom overload actions should be named using reverse DNS to ensure uniqueness.

    triggers

    (repeated config.overload.v3.Trigger, REQUIRED) A set of triggers for this action. The state of the action is the maximum state of all triggers, which can be scaling between 0 and 1 or saturated. Listeners are notified when the overload action changes state.

    typed_config

    () Configuration for the action being instantiated.

    config.overload.v3.BufferFactoryConfig

    Configuration for which accounts the WatermarkBuffer Factories should track.

    1. {
    3. }

    minimum_account_to_track_power_of_two

    (uint32) The minimum power of two at which Envoy starts tracking an account.

    Envoy has 8 power of two buckets starting with the provided exponent below. Concretely the 1st bucket contains accounts for streams that use [2^minimum_account_to_track_power_of_two, 2^(minimum_account_to_track_power_of_two + 1)) bytes. With the 8th bucket tracking accounts >= 128 * 2^minimum_account_to_track_power_of_two.

    The maximum value is 56, since we’re using uint64_t for bytes counting, and that’s the last value that would use the 8 buckets. In practice, we don’t expect the proxy to be holding 2^56 bytes.

    If omitted, Envoy should not do any tracking.

    1. {
    2.   "refresh_interval": "{...}",
    3.   "resource_monitors": [],
    4.   "actions": [],
    5.   "buffer_factory_config": "{...}"

    refresh_interval

    (Duration) The interval for refreshing resource usage.

    resource_monitors

    (repeated , REQUIRED) The set of resources to monitor.

    actions

    (repeated config.overload.v3.OverloadAction) The set of overload actions.

    buffer_factory_config