Parquet Format

    The Apache Parquet format allows to read and write Parquet data.

    Here is an example to create a table using Filesystem connector and Parquet format.

    2.   item_id BIGINT,
    3.   category_id BIGINT,
    5.   ts TIMESTAMP(3),
    6.   dt STRING
    8.  'path' = '/tmp/user_behavior',
    9.  'format' = 'parquet'
    10. )

    Currently, Parquet format type mapping is compatible with Apache Hive, but different with Apache Spark:

    • Timestamp: mapping timestamp type to int96 whatever the precision is.