Overview

1. The boundary between the core processing flow and the hierarchical module is blurred:

• Entrance and EngineManager function boundaries are blurred.

• The main process of task submission and execution is not clear enough.

1. Demands for richer and more powerful computing governance functions:

• Insufficient support for computing task management strategies.

• The labeling capability is not strong enough, which restricts computing strategies and resource managemen.

The new architecture of Linkis1.0 computing governance service can solve these problems well.

Entrance Architecture Design

1. ResourceManager not only has Linkis0.X’s resource management capabilities for Yarn and Linkis EngineManager, but also provides tag-based multi-level resource allocation and recycling capabilities, allowing ResourceManager to have full resource management capabilities across clusters and across computing resource types;
2. EngineConnPlugin is mainly used to reduce the access cost of new computing storage, so that users can access a new computing storage engine only by implementing one class.
   

Enter EngineConnManager Architecture Design