Authenticating to Azure

    Certain Azure components for Dapr offer support for the common Azure authentication layer, which enables applications to access data stored in Azure resources by authenticating with Azure AD. Thanks to this, administrators can leverage all the benefits of fine-tuned permissions with RBAC (Role-Based Access Control), and applications running on certain Azure services such as Azure VMs, Azure Kubernetes Service, or many Azure platform services can leverage Managed Service Identities (MSI).

    Some Azure components offer alternative authentication methods, such as systems based on “master keys” or “shared keys”. Whenever possible, it is recommended that you authenticate your Dapr components using Azure AD for increased security and ease of management, as well as for the ability to leverage MSI if your app is running on supported Azure services.

    Azure AD is Azure’s identity and access management (IAM) solution, which is used to authenticate and authorize users and services.

    Azure AD is built on top of open standards such OAuth 2.0, which allows services (applications) to obtain access tokens to make requests to Azure services, including Azure Storage, Azure Key Vault, Cosmos DB, etc. In the Azure terminology, an application is also called a “Service Principal”.

    Many of the services listed above also support authentication using other systems, such as “master keys” or “shared keys”. Although those are always valid methods to authenticate your application (and Dapr continues to support them, as explained in each component’s reference page), using Azure AD when possible offers various benefits, including:

    • The ability to leverage Managed Service Identities, which allow your application to authenticate with Azure AD, and obtain an access token to make requests to Azure services, without the need to use any credential. When your application is running on a supported Azure service (including, but not limited to, Azure VMs, Azure Kubernetes Service, Azure Web Apps, etc), an identity for your application can be assigned at the infrastructure level.
      This way, your code does not have to deal with credentials of any kind, removing the challenge of safely managing credentials, allowing greater separation of concerns between development and operations teams and reducing the number of people with access to credentials, and lastly simplifying operational aspects–especially when multiple environments are used.
    • Using RBAC (Role-Based Access Control) with supported services (such as Azure Storage and Cosmos DB), permissions given to an application can be fine-tuned, for example allowing restricting access to a subset of data or making it read-only.
    • Better auditing for access.
    • Ability to authenticate using certificates (optional).

    Credentials metadata fields

    To authenticate with Azure AD, you will need to add the following credentials as values in the metadata for your Dapr component (read the next section for how to create them). There are multiple options depending on the way you have chosen to pass the credentials to your Dapr service.

    Authenticating using client credentials:

    When running on Kubernetes, you can also use references to Kubernetes secrets for any or all of the values above.

    Authenticating using a PFX certificate:

    When running on Kubernetes, you can also use references to Kubernetes secrets for any or all of the values above.

    Authenticating with Managed Service Identities (MSI):

    Using MSI you’re not required to specify any value, although you may optionally pass azureClientId if needed.

    For backwards-compatibility reasons, the following values in the metadata are supported as aliases, although their use is discouraged.

    To start, create a new Azure AD application, which will also be used as Service Principal.

    Prerequisites:

    • Azure Subscription
    • jq
    • OpenSSL (included by default on all Linux and macOS systems, as well as on WSL)
    • The scripts below are optimized for a bash or zsh shell

    First, create the Azure AD application with:

    1. # Friendly name for the application / Service Principal
    2. APP_NAME="dapr-application"
    4. # Create the app
    5. APP_ID=$(az ad app create \
    6.   --display-name "${APP_NAME}" \
    7.   --available-to-other-tenants false \
    8.   --oauth2-allow-implicit-flow false \
    9.   | jq -r .appId)

    To create a client secret, then run this command. This will generate a random password based on the base64 charset and 40-characters long. Additionally, it will make the password valid for 2 years, before it will need to be rotated:

    1. az ad app credential reset \
    2.   --id "${APP_ID}" \
    3.   --years 2 \
    4.   --password $(openssl rand -base64 30)

    The ouput of the command above will be similar to this:

    1. {
    2.   "appId": "c7dd251f-811f-4ba2-a905-acd4d3f8f08b",
    3.   "name": "c7dd251f-811f-4ba2-a905-acd4d3f8f08b",
    4.   "password": "Ecy3XG7zVZK3/vl/a2NSB+a1zXLa8RnMum/IgD0E",
    5.   "tenant": "cd4b2887-304c-47e1-b4d5-65447fdd542b"
    6. }

    Take note of the values above, which you’ll need to use in your Dapr components’ metadata, to allow Dapr to authenticate with Azure:

    • appId is the value for azureClientId
    • password is the value for azureClientSecret (this was randomly-generated)
    • is the value for azureTenantId

    If you’d rather use a PFX (PKCS#12) certificate, run this command which will create a self-signed certificate:

    1. az ad app credential reset \
    2.   --id "${APP_ID}" \
    3.   --create-cert

    The output of the command above should look like:

    Take note of the values above, which you’ll need to use in your Dapr components’ metadata:

    • appId is the value for azureClientId
    • tenant is the value for azureTenantId
    • The self-signed PFX certificate and private key are written in the file at the path specified in fileWithCertAndPrivateKey.
      Use the contents of that file as azureCertificate (or write it to a file on the server and use azureCertificateFile)

    While the generated file has the .pem extension, it contains a certificate and private key encoded as PFX (PKCS#12).

    Once you have created an Azure AD application, create a Service Principal for that application, which will allow us to grant it access to Azure resources. Run:

    1. SERVICE_PRINCIPAL_ID=$(az ad sp create \
    2.   --id "${APP_ID}" \
    3.   | jq -r .objectId)
    4. echo "Service Principal ID: ${SERVICE_PRINCIPAL_ID}"

    The output will be similar to:

    1. Service Principal ID: 1d0ccf05-5427-4b5e-8eb4-005ac5f9f163

    Note that the value above is the ID of the Service Principal which is different from the ID of application in Azure AD (client ID)! The former is defined within an Azure tenant and is used to grant access to Azure resources to an application. The client ID instead is used by your application to authenticate. To sum things up:

    • You’ll use the client ID in Dapr manifests to configure authentication with Azure services

    Keep in mind that the Service Principal that was just created does not have access to any Azure resource by default. Access will need to be granted to each resource as needed, as documented in the docs for the components.

    In this example, you will set up an Azure Key Vault secret store component that uses Azure AD to authenticate.

    To use a client secret, create a file called azurekeyvault.yaml in the components directory, filling in with the details from the above setup process:

    1. apiVersion: dapr.io/v1alpha1
    2. kind: Component
    3. metadata:
    4.   name: azurekeyvault
    5.   namespace: default
    6. spec:
    7.   type: secretstores.azure.keyvault
    8.   version: v1
    9.   metadata:
    10.   - name: vaultName
    11.     value: "[your_keyvault_name]"
    12.   - name: azureTenantId
    13.     value: "[your_tenant_id]"
    14.   - name: azureClientId
    15.     value: "[your_client_id]"
    16.   - name: azureClientSecret
    17.     value : "[your_client_secret]"
    1. apiVersion: dapr.io/v1alpha1
    2. kind: Component
    3. metadata:
    4.   name: azurekeyvault
    5.   namespace: default
    6. spec:
    7.   type: secretstores.azure.keyvault
    8.   version: v1
    9.   metadata:
    10.   - name: vaultName
    11.     value: "[your_keyvault_name]"
    12.   - name: azureTenantId
    13.     value: "[your_tenant_id]"
    14.   - name: azureClientId
    15.     value: "[your_client_id]"
    16.   - name: azureCertificateFile
    17.     value : "[pfx_certificate_file_fully_qualified_local_path]"

    In Kubernetes, you store the client secret or the certificate into the Kubernetes Secret Store and then refer to those in the YAML file.

    To use a client secret:

    1. Create a Kubernetes secret using the following command:

      • [your_client_secret] is the application’s client secret as generated above
      • [your_k8s_secret_name] is secret name in the Kubernetes secret store
      • [your_k8s_secret_key] is secret key in the Kubernetes secret store

    2. Create an azurekeyvault.yaml component file.

      The component yaml refers to the Kubernetes secretstore using auth property and secretKeyRef refers to the client secret stored in the Kubernetes secret store.

      1. apiVersion: dapr.io/v1alpha1
      3. metadata:
      4.   name: azurekeyvault
      5.   namespace: default
      6. spec:
      7.   type: secretstores.azure.keyvault
      8.   version: v1
      9.   metadata:
      10.   - name: vaultName
      11.     value: "[your_keyvault_name]"
      12.   - name: azureTenantId
      13.     value: "[your_tenant_id]"
      14.   - name: azureClientId
      15.     value: "[your_client_id]"
      16.     secretKeyRef:
      17.       name: "[your_k8s_secret_name]"
      18.       key: "[your_k8s_secret_key]"
      19. auth:
      20.   secretStore: kubernetes

    3. Apply the azurekeyvault.yaml component:

      1. kubectl apply -f azurekeyvault.yaml

    To use a certificate:

    1. Create a Kubernetes secret using the following command:

      1. kubectl create secret generic [your_k8s_secret_name] --from-file=[your_k8s_secret_key]=[pfx_certificate_file_fully_qualified_local_path]
      • [pfx_certificate_file_fully_qualified_local_path] is the path to the PFX file you obtained earlier
      • [your_k8s_secret_name] is secret name in the Kubernetes secret store
      • [your_k8s_secret_key] is secret key in the Kubernetes secret store

    2. Create an azurekeyvault.yaml component file.

      The component yaml refers to the Kubernetes secretstore using auth property and secretKeyRef refers to the certificate stored in the Kubernetes secret store.

      1. apiVersion: dapr.io/v1alpha1
      2. kind: Component
      3. metadata:
      4.   name: azurekeyvault
      5.   namespace: default
      6. spec:
      7.   type: secretstores.azure.keyvault
      8.   version: v1
      9.   metadata:
      10.   - name: vaultName
      11.     value: "[your_keyvault_name]"
      12.   - name: azureTenantId
      13.     value: "[your_tenant_id]"
      14.   - name: azureClientId
      15.     value: "[your_client_id]"
      16.   - name: azureCertificate
      17.     secretKeyRef:
      18.       name: "[your_k8s_secret_name]"
      19.       key: "[your_k8s_secret_key]"
      20. auth:
      21.   secretStore: kubernetes

    3. Apply the azurekeyvault.yaml component:

    Using Managed Service Identities

    Using MSI, authentication happens automatically by virtue of your application running on top of an Azure service that has an assigned identity. For example, when you create an Azure VM or an Azure Kubernetes Service cluster and choose to enable a managed identity for that, an Azure AD application is created for you and automatically assigned to the service. Your Dapr services can then leverage that identity to authenticate with Azure AD, transparently and without you having to specify any credential.

    To get started with managed identities, first you need to assign an identity to a new or existing Azure resource. The instructions depend on the service use. Below are links to the official documentation:

    Other Azure application services may offer support for MSI; please check the documentation for those services to understand how to configure them.

    After assigning a managed identity to your Azure resource, you will have credentials such as:

    1. {
    2.     "principalId": "<object-id>",
    3.     "tenantId": "<tenant-id>",
    4.     "type": "SystemAssigned",
    5.     "userAssignedIdentities": null
    6. }

    From the list above, take note of principalId which is the ID of the Service Principal that was created. You’ll need that to grant access to Azure resources to your Service Principal.

    • Azure public cloud (default): "AZUREPUBLICCLOUD"
    • Azure China: "AZURECHINACLOUD"
    • Azure Government:
    • Azure Germany: "AZUREGERMANCLOUD"

    References

    Last modified June 23, 2022: Merge pull request #2550 from ItalyPaleAle/cosmosdb-harcoded-dapr-version (cf03237)