Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cherry-pick patches for 0.4.x #1660

Merged
merged 35 commits into from May 13, 2024
Merged

cherry-pick patches for 0.4.x #1660

merged 35 commits into from May 13, 2024

Conversation

fanqi1909
Copy link
Collaborator

@fanqi1909 fanqi1909 commented May 6, 2024

fix(clickhousech@m-3033450748): [CP to 2.1]fix metrics2 not init and update hdfs to support more metrics
feat(clickhousech@m-17104648): merge progress to cnch 2.1
feat(clickhousech@m-5301115): Merge branch 'rpc-client-base-brpc-timeout' into 'cnch-2.1'
feat(clickhousech@m-3011597342): [cp]add function sparkHashSimple to align with Spark
fix(optimizer@m-3000537417): fix bitmap index
fix(clickhousech@m-12459087):Suppress otel header parse exception[cp]
fix(clickhousech@m-3460279495): [cp cnch-2.1]minor fix edge case for PB consuming: Invalid number of rows in Chunk
feat(clickhousech@m-11932130): ProfileEvent for prewhere
feat(clickhousech@m-3404807508): [cp-cnch2.1] memory control on joined block
feat(clickhousech@m-3348298112): Ingest with bucket pick 2.1
fix(optimizer@m-3459430016): delete legacy histogram when re-collect stats without histogram
fix(clickhousech@m-3348189669): [CP to 2.1]add node info when read data part failed
fix(clickhousech@m-3158769174): [cp cnch-2.1] change the order of loading index to avoid unnecessary loading
fix(clickhousech@m-3595158575): fix report root cause
fix(clickhousech@m-3459432705): [cp] fix rollback of detach partition
feat(optimizer@m-3000286965): remove redundant cast
fix(clickhousech@m-3595136086): skip access storage when enable_skip_non_cnch_tables_for_cnch_trash_items is enabled.
feat(clickhousech@m-3011045309): [CP to 2.1]CnchMergeTree support bytecool part move parser
fix(clickhousech@m-3671861263): fixed conjunct the where and prewhere in getFilterFromQueryInfo
fix(clickhousech@m-3595103553): [manual cp] fix toCNCHDataPart lost commit time and add some catalog debug log
fix(clickhousech@m-3671827753): [cp] Make sure cluster_status set to 0 after modify cluster by
fix(clickhousech@m-3460291004): move setUser to async thread

@fanqi1909 fanqi1909 force-pushed the 0.4.x-cp-05-06 branch 4 times, most recently from a64a46d to 78a5c07 Compare May 8, 2024 02:22
fix(clickhousech@m-3033450748): [CP to 2.1]fix metrics2 not init and update hdfs to support more metrics

See merge request dp/ClickHouse!20981
feat(clickhousech@m-17104648): send progress in optimizer mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19287

# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/DistributedStages/PlanSegmentExecutor.cpp
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
#	src/Interpreters/SegmentScheduler.cpp
feat(clickhousech@m-5301115): rpc client base brpc timeout should read config

See merge request dp/ClickHouse!20862
# Conflicts:
#	src/DaemonManager/DaemonManager.cpp
#	src/DaemonManager/tests/gtest_backgroundjob.cpp
feat(clickhousech@m-3011597342): [cp]add function sparkHashSimple to align with Spark

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20931
fix(optimizer@m-3000537417): fix bitmap index not pushed down

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20992
fix(clickhousech@m-12459087):Suppress otel header parse exception[cp]

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20407
fix(clickhousech@m-3460279495): [cp cnch-2.1]minor fix edge case for PB consuming: Invalid number of rows in Chunk

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21039
feat(clickhousech@m-14198773): push implicit column to prewhere

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20990
# Conflicts:
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
feat(clickhousech@m-11932130): ProfileEvent for prewhere

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21015
feat(clickhousech@m-3404807508): [CNCH] memory control on joined block

See merge request dp/ClickHouse!20820
# Conflicts:
#	src/Interpreters/HashJoin.cpp
feat(clickhousech@m-3348298112): Ingest with bucket

See merge request dp/ClickHouse!20774
# Conflicts:
#	docker/CI/docker-compose-s3.yml
#	docker/CI/docker-compose-single.yml
#	docker/CI/docker-compose.yml
#	docker/CI/multi-servers/cnch-config.yml
#	docker/CI/multi-servers/daemon-manager.yml
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-servers/tso.yml
#	docker/CI/multi-servers/worker.yml
#	docker/CI/s3/daemon-manager.yml
#	docker/CI/s3/docker-compose-patch.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/tso.yml
#	docker/CI/s3/worker.yml
#	docker/CI/single-server/cnch-config.yml
#	docker/CI/single-server/daemon-manager.yml
#	docker/CI/single-server/tso.yml
#	docker/docker-compose/byconity-multi-cluster/resource-manager.yml
#	docker/docker-compose/byconity-multiworkers-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Storages/IngestColumnCnch/IngestColumnCnch.cpp
fix(optimizer@m-3459430016): delete legacy histogram when re-collect stats without histogram

See merge request dp/ClickHouse!21032
fix(clickhousech@m-3348189669): add node info when read data part failed

See merge request dp/ClickHouse!20783
# Conflicts:
#	src/Storages/MergeTree/MergeTreeReaderCNCH.cpp
fix(clickhousech@m-3158769174): [cp cnch-dev] change the order of loading index to avoid unnecessary loading

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20487
fix(clickhousech@m-3459432705): [cp] fix rollback of detach partition

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21036
feat(optimizer@m-3000286965): remove redundant cast

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21102
fix(optimizer@m-3310530537): fix cte property explore with broadcast cnch-2.1

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21115
feat(clickhousech@m-3086283635): [cp cnch-2.1] introduce sample consuming function for CnchKafka

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20392
fix(clickhousech@m-3018479783): Allow extra argument for toString

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20280
fix(clickhousech@m-3595066568): fix arrayjoin performance slow with optimizer

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21133
feat(clickhousech@m-3000999997): 【CP】refine log

See merge request dp/ClickHouse!21098
fix(clickhousech@m-3651696533): fix toDateOrNull core cnch 2.1

See merge request dp/ClickHouse!21159
fix(clickhousech@m-3460250027): not select partition key as prewhere cnch 2.1

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20958
fix(clickhousech@m-3000662130): prevent from acquire RWlock recursively

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20908
feat(clickhousech@m-3460318692): make max_bytes_to_read_local respect max_bytes_to_read_leaf

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21228
fix(clickhousech@m-3671907062): [cp] Fix cleanUndoBuffers logic for DaemonJobTxnGC to let it works well with write_undo_buffer_new_key

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21229
fix(clickhousech@m-3643636185): [cp] Make check table happens at worker side

See merge request dp/ClickHouse!21216
# Conflicts:
#	src/CloudServices/CnchWorkerClient.cpp
#	src/CloudServices/CnchWorkerClient.h
fix(clickhousech@m-3595136086): skip access storage when enable_skip_non_cnch_tables_for_cnch_trash_items is enabled.

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21200
feat(clickhousech@m-3011045309): [CP to 2.1]CnchMergeTree support bytecool part move parser

See merge request dp/ClickHouse!20730
fix(clickhousech@m-3671861263): fixed conjunct the where and prewhere in getFilterFromQueryInfo

See merge request dp/ClickHouse!21244
fix(clickhousech@m-3595103553): [manual cp] fix toCNCHDataPart lost commit time and add some catalog debug log

See merge request dp/ClickHouse!21224
fix(clickhousech@m-3671827753): [cp] Make sure cluster_status set to 0 after modify cluster by

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21258
fix(clickhousech@m-3460291004): move setUser to async thread

See merge request dp/ClickHouse!21270
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
@fanqi1909 fanqi1909 changed the title [WIP] cherry-pick patches for 0.4.x cherry-pick patches for 0.4.x May 13, 2024
@fanqi1909 fanqi1909 merged commit d5e5787 into release/0.4.x May 13, 2024
2 checks passed
@fanqi1909 fanqi1909 deleted the 0.4.x-cp-05-06 branch May 13, 2024 09:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants