zh-cn | en-us

query_clickhouse

Connect to clickhouse, and from which query data with sqls.

---

Project Directory

Here are three most important directories:

1. etc/: All of configurations and default settings are here.

   Notes: 'profile.py' is very important for your privacy(be careful when pushing codes), for it includes many authentication settings. 'logging.json' is just for logging runtime informations.

2. data/: src ----script process----> result. Notes: 'src/' and 'result/' are corresponding with each other.

3. script/: typical javaweb directories(controller <------service<------utils).

Quick Start

1. Set your authentication settings in 'profile.py'.

2. Modify '/script/query_sql.py':

   2.1 Clone your target project within X-lab2017/github-analysis-report, which can be a sub directory of 'github-analysis-report/sql/' or a sub directory of 'github-analysis-report/case-study/sql/'. Drop the copies in 'data/src/'.

   2.2 Modify the pre-process and post-processor logic if necessary.

3. Run 'script/service/query_sql.py'. Check results in the directory 'data/result'.

Related links

1. Related projects: X-lab2017/github-analysis-report

2. Official account and article: 重磅 |《GitHub 2020 数字洞察报告》正式发布

3. Related resources: 《GitHub 2020 数字洞察报告》

4. Laboratory introduction: X-Lab

Description: this projectbirdflyi/query_clickhouse is associated with project X-lab2017/github-analysis-report. Some functions keep consistent with 《GitHub 2020 数字洞察报告》. Refer to the official account：重磅 |《GitHub 2020 数字洞察报告》正式发布.