Create checks

A check consists of two parts – a query and check configuration.

Check query

  • Specifies the dataset to monitor.
  • May include tags to narrow results.

Check configuration

  • Evaluates specified conditions and applies a status (if applicable) to each data point:
    • warn
    • info
    • ok
  • Stores status in the _level column.

There are two types of checks:

Threshold check

A threshold check assigns a status based on a value being above, below, inside, or outside of defined thresholds.

Deadman check

A deadman check assigns a status to data when a series or group doesn’t report in a specified amount of time.

  1. In the navigation menu on the left, select Alerts > Alerts.

    Alerts

  2. Click Create and select the type of check to create.

  3. Click Name this check in the top left corner and provide a unique name for the check, and then do the following:

  4. (Optional) In the Name this check field at the top, enter a unique name for the check.

Configure the check query

  1. If creating a threshold check, select an aggregate function. Aggregate functions aggregate data between the specified check intervals and return a single value for the check to process.

    In the Aggregate functions column, select an interval from the interval drop-down list (for example, “Every 5 minutes”) and an aggregate function from the list of functions.

  2. Click Submit to run the query and preview the results. To see the raw query results, click the View Raw Data toggle.

Configure the check

  1. Click 2. Configure Check near the top of the window.

  2. In the Properties column, configure the following:

    Schedule Every

    Select the interval to run the check (for example, “Every 5 minutes”). This interval matches the aggregate function interval for the check query. Changing the interval here will update the aggregate function interval.

    Offset

    Delay the execution of a task to account for any late data. Offset queries do not change the queried time range.

    Your offset must be shorter than your .

    Tags

    Use custom tags to associate additional metadata with the check. Common metadata tags across different checks lets you easily group and organize checks. You can also use custom tags in .

  3. Define check conditions that assign statuses to points. Condition options depend on your check type.

    Configure a threshold check
    1. In the Thresholds column, click the status name (CRIT, WARN, INFO, or OK) to define conditions for that specific status.
    2. From the When value drop-down list, select a threshold: is above, is below, is inside of, is outside of.
    3. Enter a value or values for the threshold. You can also use the threshold sliders in the data visualization to define threshold values.
    Configure a deadman check
    1. In the Deadman column, enter a duration for the deadman check in the for field. For example, 90s, 5m, 2h30m, etc.
    2. Use the set status to drop-down list to select a status to set on a dead series.
    3. In the And stop checking after field, enter the time to stop monitoring the series. For example, 30m, 2h, , etc.
  4. Click the green in the top right corner to save the check.

Create a new check by cloning an existing check.

  1. Go to Alerts > Alerts in the navigation on the left.

  2. Click the icon next to the check you want to clone and then click Clone.