• Creation of repositories, relying on existing brokers or accessing cloud storage directly through AWS s3 protocol, or accessing HDFS directly.
    • If it is a read-only repository, restores can only be done on the repository. If not, backup and restore operations are available.
    • PROPERTIES are different according to different types of broker or S3 or hdfs, see the example for details.
    • ON LOCATION ： if it is S3 , here followed by the Bucket Name.
    1. Create a warehouse named bos_repo, rely on BOS broker “bos_broker”, and the data root directory is: bos://palo_backup
    2. WITH BROKER `bos_broker`
    3. ON LOCATION "bos://palo_backup"
    4. PROPERTIES
    5.     "bos_endpoint" = "http://gz.bcebos.com",
    6.     "bos_accesskey" = "bos_accesskey",
    7.     "bos_secret_accesskey"="bos_secret_accesskey"
    8. );
    1. Create the same repository as Example 1, but with read-only properties:
    1. Create a warehouse named hdfs_repo, rely on Baidu hdfs broker “hdfs_broker”, the data root directory is: hdfs://hadoop-name-node:54310/path/to/repo/
    2. WITH BROKER `hdfs_broker`
    3. ON LOCATION "hdfs://hadoop-name-node:54310/path/to/repo/"
    4. PROPERTIES
    5. (
    6.     "username" = "user",
    7.     "password" = "password"
    8. );
    1. Create a repository named hdfs_repo to link HDFS directly without going through the broker.
    1. CREATE REPOSITORY `hdfs_repo`
    3. ON LOCATION "hdfs://hadoop-name-node:54310/path/to/repo/"
    4. PROPERTIES
    5. (
    6.     "fs.defaultFS"="hdfs://hadoop-name-node:54310",
    7.     "hadoop.username"="user"
    8. );
    10. ### Keywords
    1. Create a repository named minio_repo to link minio storage directly through the s3 protocol.
    1. A cluster can create multiple warehouses. Only users with ADMIN privileges can create repositories.
    2. When performing data migration operations, it is necessary to create the exact same warehouse in the source cluster and the destination cluster, so that the destination cluster can view the data snapshots backed up by the source cluster through this warehouse.