S3 Load

    This document mainly introduces how to import data stored in AWS S3. It also supports the import of other object storage systems that support the S3 protocol, such as Baidu Cloud’s BOS, Alibaba Cloud’s OSS and Tencent Cloud’s COS, etc.

    • Source data in S3 protocol accessible storage systems, such as S3, BOS.
    1. Standard AK and SK First, you need to find or regenerate AWS , you can find the generation method in of AWS console, as shown in the following figure: AK_SK Select and pay attention to save and generate AK and SK.
    2. Prepare REGION and ENDPOINT REGION can be selected when creating the bucket or can be viewed in the bucket list. ENDPOINT can be found through REGION on the following page

    Like Broker Load just replace with

    S3 SDK uses virtual-hosted style by default. However, some object storage systems may not be enabled or support virtual-hosted style access. At this time, we can add the parameter to force the use of path style: