- Support connecting to Doris clusters through JDBC Catalog.
Currently, Jdbc Catalog only support to use 5.x version of JDBC jar package to connect another Doris database. If you use 8.x version of JDBC jar package, the data type of column may not be matched.
Support to synchronize only the specified database through the
Support synchronizing table names in the form of lowercase through
lower_case_table_namesto solve the problem of case sensitivity of table names.
- Optimize the read performance of JDBC Catalog.
Support Array type mapping.
Support whether to push down the like expression through the
like_push_downattribute to control the CPU overhead of the ES cluster.
Support Hive table default partition
Hive Metastore metadata automatic synchronization supports notification event in compressed format.
Dynamic Partition Improvement
- Dynamic partition supports specifying the
storage_mediumparameter to control the storage medium of the newly added partition.
Optimize BE's Threading Model
- Optimize BE's threading model to avoid stability problems caused by frequent thread creation and destroy.
Fixed issues with Merge-On-Write Unique Key tables.
Fixed compaction related issues.
Fixed some delete statement issues causing data errors.
Fixed several query execution errors.
Fixed the problem of using JDBC catalog to cause BE crash on some operating system.
Fixed Multi-Catalog issues.
Fixed memory statistics and optimization issues.
Fixed decimalV3 and date/datetimev2 related issues.
Fixed load transaction stability issues.
Fixed light-weight schema change issues.
Fixed the issue of using
datetimetype for batch partition creation.
Fixed the problem that a large number of failed broker loads would cause the FE memory usage to be too high.
Fixed the problem that stream load cannot be canceled after dropping the table.
information_schematimeout in some cases.
Fixed the problem of BE crash caused by concurrent data export using
Fixed transactional insert operation memory leak.
Fixed several query/load profile issues, and supports direct download of profiles through FE web ui.
Fixed the problem that the BE tablet GC thread caused the IO util to be too high.
Fixed the problem that the commit offset is inaccurate in Kafka routine load.