Python Engine

    1. HADOOP_HOME=${Real hadoop configuration directory}
    2. HADOOP_CONF_DIR=${Real hadoop installation directory}

    1.2 Dependent service startup

    1.4 Determination of python execution path

    1.     The python environment in the user cluster is very different. Liniks recommends that users use the anaconda release version.
    3.     In addition, users can specify the path of the python interpreter in the configuration file linkis-engine.properties of pythonEngineManger. The specific method is

      1.6 running examples

      1.     In the web browser, open the address of scriptis, the user can create a new python script in the workspace on the left column and write the script code in the script editing area, and the writing is complete After that, click Run to submit your code to the Linkis background for execution. After submission, the background will push the log, progress, status and other information to the user in real time via websocket. And after finishing, show the result to the user.
      3.     The implementation of the execution module uses the py4j framework to allow the python executor to interact with the JVM. After the user submits the code, the JVM submits the code to the py4j framework The python interpreter executes and gets the output or error message from the python process.
      1. The deployment method is simpler, try to use the containerized method.
      2. Better support the submission of spark’s yarn-cluster mode.