Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tidb source] 通过flink-cdc 支持tidb 增量读取 #214

Open
baisui1981 opened this issue Apr 14, 2023 · 0 comments
Open

[tidb source] 通过flink-cdc 支持tidb 增量读取 #214

baisui1981 opened this issue Apr 14, 2023 · 0 comments
Labels
bug Something isn't working
Milestone

Comments

@baisui1981
Copy link
Member

baisui1981 commented Apr 14, 2023

目前TiDB 只能批量读取,可以通过flink-cdc来支持增量读取

利用 tiup来服务端stub: https://docs.pingcap.com/zh/tidb/stable/quick-start-with-tidb

在读取TiDB 表Meta Data 过程中会报异常

	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.UnsupportedOperationException: null
	at com.qlangtech.tis.plugin.ds.tidb.TiKVDataSourceFactory.getDbConfig(TiKVDataSourceFactory.java:169)
	at com.qlangtech.tis.plugin.datax.common.TableColsMeta.<init>(TableColsMeta.java:47)
	at com.qlangtech.tis.plugin.datax.common.BasicDataXRdbmsReader.getTabsMeta(BasicDataXRdbmsReader.java:227)
	at com.qlangtech.tis.plugin.datax.common.BasicDataXRdbmsReader.getSelectedTabs(BasicDataXRdbmsReader.java:88)
	at com.qlangtech.tis.datax.IDataxReader.hasMulitTable(IDataxReader.java:38)
	at com.qlangtech.tis.coredefine.module.action.DataxAction.doGetTableMapper(DataxAction.java:876)
	... 124 common frames omitted
@baisui1981 baisui1981 added 3.8.0 and removed 3.8.0 labels Apr 14, 2023
@baisui1981 baisui1981 added this to the v3.8.0 milestone Apr 14, 2023
@baisui1981 baisui1981 added the bug Something isn't working label Apr 14, 2023
@baisui1981 baisui1981 modified the milestones: v3.8.0, v4.0.0 Sep 24, 2023
@baisui1981 baisui1981 modified the milestones: v4.0.0, V4.1.0 Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant