Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About performance between ByConity0.3.2 and Clickhouse 23.1.3 #1398

Open
merseyalma opened this issue Mar 19, 2024 · 3 comments
Open

About performance between ByConity0.3.2 and Clickhouse 23.1.3 #1398

merseyalma opened this issue Mar 19, 2024 · 3 comments
Assignees
Labels
question Further information is requested

Comments

@merseyalma
Copy link

merseyalma commented Mar 19, 2024

I made a performance comparison between ByConity0.3.2 and Clickhouse 23.1.3.

It contains two items.

  • a csv file has 104 fields and 2.15M records, import it to a table named A in the two databases;
  • execute a sql which stats A in the two databases;

the result:

database hardware import execution
ClickHouse server 23.1.3 16G Memery 8 Core 2.1Ghz CPU 16s 3.9s
ByConity0.3.2 16G Memery 8 Core 2.1Ghz CPU 20s 6.5s

Could you help me to explain why the import and execution in ByConity is slower than Clickhouse, and help me to optimize ? If you can , contact me by Webchat ( id:merseyalma) to get more details about data and table denifition.

@kevinthfang
Copy link
Contributor

  1. Could you please explain how you deploy byconity? E.g. Are you using HDFS or S3? If hdfs, how the HDFS is deployed?
  2. Is the execution 1st time query?

@kevinthfang kevinthfang assigned Adora627 and GallifreyY and unassigned Adora627 Mar 25, 2024
@merseyalma
Copy link
Author

1 deploy by docker-compose. I only changed .env file as below

COMPOSE_PROJECT_NAME="random"

DATA_DIR=./data
SERVER_TCP_PORT=9123
SERVER_HTTP_PORT=8123

#BYCONITY_IMAGE=byconity/debian-runner
BYCONITY_IMAGE=byconity/byconity:0.3.2
#BYCONITY_BINARY_PATH=~/ck/ByConity/build_docker/programs
BYCONITY_BINARY_PATH=

docker-compose -f docker-compose.essentials.yml -f docker-compose.simple.yml up -d
  1. I executed the sql for several times.

@kevinthfang kevinthfang added the question Further information is requested label Apr 23, 2024
@kevinthfang
Copy link
Contributor

Did you deploy 'ClickHouse server 23.1.3' also using docker? about '16G Memery 8 Core 2.1Ghz CPU' is it restrained in docker config, or it's just your physical node resources?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants