RFC-008: Complication Improvement

[zhanghaohit]

Problem

The current complication steps are:

• Download thirdparty deps and init env:

  bash steps/init_env.sh
  

• Build using cmake

  mkdir build && cd build
  cmake ..
  make -j5 openmldb
  

The problems are:

• Hybridse should not be a thirdparty. It can be integrated into the OpenMLDB complication task (Issue build(cmake): add hybridse to root CMakeLists.txt #625)
• The special handling for thirdparty deps is not standard. The extra step is not necessary
• Some thirdparty deps are from personal github repos. Have to move to the official repos
• Most thirdparty libraries are pre-compiled/binary, which means that it only works on pre-defined platform (OS, arch). For example, we cannot support compile in Ubuntu for now (Issue build: support build and test on popular linux distributions (e.g ubuntu) #619)
• It requires a long time to download the thirdparty deps (Issue Speed up downloads of third-party dependencies #601)
• zetasql lib is not up-to-date (Issue Bug: zetasql lib isn't up-to-date after running init_env.sh #550)

Issues:

• build: support build and test on popular linux distributions (e.g ubuntu) #619
• Speed up downloads of third-party dependencies #601
• build(third-party): allow compile thirdparty directly from source #618
• build(cmake): add hybridse to root CMakeLists.txt #625
• Bug: zetasql lib isn't up-to-date after running init_env.sh #550
• move thirdparty repos to 4paradigm #669
• Integrate third-party dependencies into docker image (hybridsql image) #670

Existing PRs:

• build: manage thirdparty & zetasql via cmake #594
  • Manage thirdparty in Makefile and cmake
  • complie zetasql from source

Solution

To solve the existing problems, we plan to:

• Integrate hybridse into CMakeLists.txt
• remove init_env.sh steps: this will be addressed in PR build: manage thirdparty & zetasql via cmake #594
• move thirdparty repos to 4paradigm
  • https://github.com/jingchen2222/hybridsql-asserts
  • https://github.com/aceforeverd/zetasql
• docker images with built dependency for centos only, except zetasql
• Support compilation from sources for all thirdparty libraries (Option: ON/OFF)
  • Add ubuntu pre-compiled thirdparty
  • test on both centos & ubuntu, os & toolchain dependency
• maintain/use an extra clone of thirdparty repo in gitee.com or cloud for cn users
• docker image mirrors
• support compile zetasql lib from source (PR build: manage thirdparty & zetasql via cmake #594)

Changes and Additions to Public Interfaces

Update the Build & Install docs

Performance Impact

The whole complication process will takes longer if compiling thirdparty from sources is turned on.

Backwards Compatibility and Upgrade Path

N.A.