synch - ClickHouse Administration Tool

synch is a CLI tool designed to facilitate the administration and synchronization of ClickHouse databases. It provides commands to move table parts between disks, drain disks, dump schemas, synchronize tables across clusters, and replay query history for benchmarking purposes.

Features

• Move table parts between disks within the same database.
• Move parts from all tables from one disk to another.
• Dump database schemas to a file.
• Synchronize a table across different clusters.
• Replay a portion of the query history for benchmarking.

Installation

# Clone the repository
git clone https://github.com/posthog/synch.git

# Navigate to the synch directory
cd synch

# Build the project (Go must be installed)
go build -o synch

# Optionally, move the binary to a directory in your PATH
mv synch /usr/local/bin/

Usage

Before using the tool, ensure that all environmental variables required for database connections are properly set or provided in a .env file.

Here's a quick rundown of the commands available:

# Basic usage
./synch

# Move table parts from one disk to another
./synch moveto <from_disk> <to_disk> <database> <table>

# Drain all parts from one disk to another
./synch drain-disk <from_disk> <to_disk>

# Dump database schema to file
./synch dump-schema <database>

# Synchronize a table across clusters
./synch synctable <table_name>

# Replay query history between clusters for benchmarking
./synch replay <cluster> <start_date> <end_date>

Configuration

The application is configured via environment variables. Check out .env.sample for example env vars that are required