不久之前发布了初代版本的帖子,https://www.v2ex.com/t/647495#reply5,经过一段时间的升级之后,mysql2ch 升级到了 2.0 版本,功能更完善,跪求各位 star~👉mysql2ch
mysql2ch
Introduction
mysql2ch is used to sync data from MySQL to ClickHouse.

Requirements
- kafka
- docker & docker-compose
Usage
Full data etl
$ python manage.py etl -h
usage: manage.py etl [-h] --schema SCHEMA --tables TABLES [--debug]
optional arguments:
-h, --help show this help message and exit
--schema SCHEMA Schema to full etl.
--tables TABLES Tables to full etl,multiple tables split with comma.
--debug Display SQL information.
Continuous Sync
cp .env.example .envand edit it.- edit
docker-compose.yml,which will read.env,add your own consumer.One consumer consume one kafka partition. docker-compose up -d.
Optional
- sentry,error reporting,worked if set
SENTRY_DSNin.env.