Resource Groups

    The resource groups and associated selection rules are configured by a manager which is pluggable. Add an file with the following contents to enable the built-in manager that reads a JSON config file:

    Change the value of resource-groups.config-file to point to a JSON config file, which can be an absolute path, or a path relative to the Presto data directory.

    • name (required): name of the group. May be a template (see below).

    • maxQueued (required): maximum number of queued queries. Once this limit is reached new queries will be rejected.

    • hardConcurrencyLimit (required): maximum number of running queries.

    • softMemoryLimit (required): maximum amount of distributed memory this group may use before new queries become queued. May be specified as an absolute value (i.e. 1GB) or as a percentage (i.e. 10%) of the cluster’s memory.

    • softCpuLimit (optional): maximum amount of CPU time this group may use in a period (see cpuQuotaPeriod) before a penalty will be applied to the maximum number of running queries. hardCpuLimit must also be specified.

    • hardCpuLimit (optional): maximum amount of CPU time this group may use in a period.

    • schedulingPolicy (optional): specifies how queued queries are selected to run, and how sub-groups become eligible to start their queries. May be one of three values:

    • schedulingWeight (optional): weight of this sub-group. See above. Defaults to 1.

    • jmxExport (optional): If true, group statistics are exported to JMX for monitoring. Defaults to false.

    • perQueryLimits (optional): specifies max resources each query in a resource group may consume before being killed. These limits are not inherited from parent groups. May set three types of limits:

    • subGroups (optional): list of sub-groups.

    • user (optional): regex to match against user name.

    • source (optional): regex to match against source string.

    • queryType (optional): string to match against the type of the query submitted:

      • DATA_DEFINITION: Queries that alter/create/drop the metadata of schemas/tables/views, and that manage prepared statements, privileges, sessions, and transactions.

      • DELETE: DELETE queries.

      • DESCRIBE: DESCRIBE, DESCRIBE INPUT, DESCRIBE OUTPUT, and SHOW queries.

      • EXPLAIN: EXPLAIN queries.

      • INSERT: INSERT and CREATE TABLE AS queries.

      • SELECT: SELECT queries.

    • clientTags (optional): list of tags. To match, every tag in this list must be in the list of client-provided tags associated with the query.

    • group (required): the group these queries will run in.

    • cpuQuotaPeriod (optional): the period in which cpu quotas are enforced.

    Selectors are processed sequentially and the first one that matches will be used.

    Client tags can be set as follows:

    In the example configuration below, there are several resource groups, some of which are templates. Templates allow administrators to construct resource group trees dynamically. For example, in the pipeline_${USER} group, will be expanded to the name of the user that submitted the query. ${SOURCE} is also supported, which will be expanded to the source that submitted the query. You may also use custom named variables in the source and user regular expressions.

    There are four selectors that define which queries run in which resource group:

    Together, these selectors implement the following policy:

    • The user “bob” is an admin and can run up to 50 concurrent queries. Queries will be run based on user-provided priority.

    For the remaining users:

    • No more than 100 total queries may run concurrently.

    • Up to 5 concurrent DDL queries with a source “pipeline” can run. Queries are run in FIFO order.

    • Non-DDL queries will run under the global.pipeline group, with a total concurrency of 45, and a per-user concurrency of 5. Queries are run in FIFO order.

    • All remaining queries are placed into a per-user group under global.adhoc.other that behaves similarly.

    1. {
    2.   "rootGroups": [
    3.       "name": "global",
    4.       "softMemoryLimit": "80%",
    5.       "hardConcurrencyLimit": 100,
    6.       "maxQueued": 1000,
    7.       "schedulingPolicy": "weighted",
    8.       "jmxExport": true,
    9.       "subGroups": [
    10.         {
    11.           "name": "data_definition",
    12.           "softMemoryLimit": "10%",
    13.           "hardConcurrencyLimit": 5,
    14.           "maxQueued": 100,
    15.           "schedulingWeight": 1
    16.         },
    17.         {
    18.           "name": "adhoc",
    19.           "softMemoryLimit": "10%",
    20.           "hardConcurrencyLimit": 50,
    21.           "maxQueued": 1,
    22.           "schedulingWeight": 10,
    23.           "subGroups": [
    24.             {
    25.               "name": "other",
    26.               "softMemoryLimit": "10%",
    27.               "hardConcurrencyLimit": 2,
    28.               "maxQueued": 1,
    29.               "schedulingWeight": 10,
    30.               "schedulingPolicy": "weighted_fair",
    31.               "subGroups": [
    32.                 {
    33.                   "name": "${USER}",
    34.                   "softMemoryLimit": "10%",
    35.                   "hardConcurrencyLimit": 1,
    36.                   "maxQueued": 100
    37.                 }
    38.               ]
    39.             },
    40.             {
    41.               "name": "bi-${tool_name}",
    42.               "softMemoryLimit": "10%",
    43.               "hardConcurrencyLimit": 10,
    44.               "maxQueued": 100,
    45.               "schedulingWeight": 10,
    46.               "schedulingPolicy": "weighted_fair",
    47.               "subGroups": [
    49.                   "name": "${USER}",
    50.                   "softMemoryLimit": "10%",
    51.                   "hardConcurrencyLimit": 3,
    52.                   "maxQueued": 10
    53.                 }
    54.               ]
    55.           ]
    56.         },
    57.         {
    58.           "name": "pipeline",
    59.           "softMemoryLimit": "80%",
    60.           "hardConcurrencyLimit": 45,
    61.           "maxQueued": 100,
    62.           "schedulingWeight": 1,
    63.           "jmxExport": true,
    64.           "subGroups": [
    65.             {
    66.               "name": "pipeline_${USER}",
    67.               "softMemoryLimit": "50%",
    68.               "hardConcurrencyLimit": 5,
    69.               "maxQueued": 100
    70.             }
    71.           ]
    72.         }
    73.       ]
    74.     },
    75.     {
    76.       "name": "admin",
    77.       "softMemoryLimit": "100%",
    78.       "hardConcurrencyLimit": 50,
    79.       "maxQueued": 100,
    80.       "schedulingPolicy": "query_priority",
    81.       "jmxExport": true
    82.     }
    83.   ],
    84.   "selectors": [
    85.     {
    86.       "user": "bob",
    87.       "group": "admin"
    88.     },
    89.     {
    90.       "source": ".*pipeline.*",
    91.       "queryType": "DATA_DEFINITION",
    92.       "group": "global.data_definition"
    93.     },
    94.     {
    95.       "source": ".*pipeline.*",
    96.       "group": "global.pipeline.pipeline_${USER}"
    97.     },
    98.     {
    99.       "source": "jdbc#(?<tool_name>.*)",
    100.       "clientTags": ["hipri"],
    101.       "group": "global.adhoc.bi-${tool_name}.${USER}"
    102.     },
    103.     {
    104.       "group": "global.adhoc.other.${USER}"
    105.     }
    106.   ],