Flink

    • Drag in the toolbarThe task node to the drawing board, as shown in the following figure:
    • Program type: supports JAVA, Scala and Python three languages
    • The class of the main function: is the full path of the Main Class, the entry point of the Flink program
    • Deployment mode: support three modes of cluster and local
    • Number of slots: You can set the number of slots
    • Number of taskManage: You can set the number of taskManage
    • TaskManager memory number: You can set the taskManager memory number
    • Command line parameters: Set the input parameters of the Spark program and support the substitution of custom parameter variables.
    • Other parameters: support —jars, —files, —archives, —conf format
    • Custom parameter: It is a local user-defined parameter of Flink, which will replace the content with ${variable} in the script

    Note: JAVA and Scala are only used for identification, there is no difference, if it is Flink developed by Python, there is no class of the main function, the others are the same