Testing Direction

[chrisfw]

Hi Jin,

I find this project very exciting as it is bringing together or will bring together a variety of components/projects that were already of great interest to me, e.g. Apache Arrow, DataFusion, Ballista.

I come from a Java background and I am not familiar with Rust yet, but I can certainly assist by testing out functionality and reporting any issues I find.

Do you have any particular area you would like users/testers of the tensorbase project to focus on in order to exercise the functionality at this point? Also, do you have a more granular roadmap you can provide to highlight upcoming features that you plan to implement?

Regards,
Chris

[jinmingjian]

@chrisfw Chris, thanks for your interests and starting a discussion!

The Java background is not the problem. There are many Rustaceans (Rust developers) from Java ecosystem. From application layer coding, the experience of Rust is almostly same to the Java. Of course, it is still need low-level thinkings to make the best use of one system language. However, if you are interested to these, you can always do best!

We have setup internal harnesses to exercise TB. (When they become matured, we will release them as well.) If you are interested, I can pull you into the project. This is a great start point (A.K.A. your "Testing Direction") to help TB to grow to an industry strength product.

For more your roadmap questions, this, in fact, indicates TB ideas has not well shown out which are scattered around the issues. I will try to enable the project panel to see if we can have a more clear big picture.

[jinmingjian]

@chrisfw yes. They are in the roadmap. To expand the client ecosystem is indeed important for next step. MySql or PgSql wire protocol will be implemented ASAP.

For harnesses, they are just for kinds of tests tools for TB. So the internal working of TB is intentionally not needed. For your want to provide testing help, it is great. You just run some tests from the queries against the TB server instance and report the bugs/unsupported queries to issues. Of course, it is also good to have a look for Rust and projects before more works. It depends on you. And I am glad to provide any help when you want.

[jinmingjian]

@chrisfw I recall there is a ClickHouse Native JDBC driver, which should be supported by TB now[1]. It would be great If you'd like do some tests and feedback the problems your found. If no problem, I hope we could add the support of Java JDBC driver in doc.

[1] https://github.com/housepower/ClickHouse-Native-JDBC

[chrisfw]

@jinmingjian , Yes, sure thing. I can work on testing the JDBC driver and report back on the results.

[chrisfw]

@jinmingjian, I tested the JDBC driver and reported my results in a new issue, which I closed because I realized the Native driver you linked is not the official driver. I will retest with the one you linked to.

I also noticed that there is also a Clickhouse ODBC driver, so please let me know if/when you would like me to begin testing it.

[jinmingjian]

@chrisfw thanks for testing. The CH's official odbc[1] is http protocol based, which has not been supported by TensorBase now.

[1] https://github.com/ClickHouse/clickhouse-odbc