Supported data sources and read-write capability

Last updated: 2024-12-19 10:14:39

DataInLong includes both offline and real-time data links, currently supporting relational databases, big data storage, semi-structured data, NoSQL, message queues, and various other data sources. You can select the corresponding feature modules based on the support of each module for the data sources to configure synchronization tasks.
Data Source
Offline Synchronization
Real-Time Synchronization
Version
Offline Read
Offline Write
Single Table Read
Single Table Write
Database-wide Read
Database-wide Write
Log Collection
Relational Database
MySQL
-
5.6,5.7,8.0.x
TDSQL-C MySQL
-
-
TDSQL MySQL
-
InnoDB Type
PostgreSQL
9.6,10,11,12
TDSQL PostgreSQL
-
-
-
-
-
5.21.6 Row and Column Storage Fusion Edition
SQL Server
-
2008,2008R2,2012,2014,2016,2017,2019
Oracle
-
11,12,19
DB2
-
-
-
-
-
-
SAP HANA
-
-
-
-
-
-
SAP IQ(Sybase)
-
-
-
-
-
-
-
DM
-
-
-
7,8
OceanBase (beta usage)
-
-
-
3.1.4,4.2.1.3
Big data
TCHouse-P
-
-
-
Hive
-
-
1.x,2.x,3.x
DLC
-
-
-
Doris
-
-
0.15、1.x
StarRocks
-
-
-
-
-
ClickHouse
-
-
-
20.7+
Iceberg
-
-
0.13.1+
HBase
-
-
-
2.2.x
HDFS
-
-
-
2.x,3.x
Kudu
-
-
-
-
-
-
TBase
-
-
-
-
GaussDB
-
-
-
-
-
-
GBase
-
-
-
-
-
-
Impala
-
-
-
-
-
-
Greenplum
-
-
-
4.x,5.x,6.x
Semi-structured
COS
-
-
-
-
-
-
Rest API
-
-
-
-
-
-
-
FTP
-
-
-
-
-
-
SFTP
-
-
-
-
-
-
NoSQL
Redis
-
-
-
-
-
-
-
Elasticsearch
-
-
-
6.x,7.x
CTSDB influxDB
-
-
-
-
-
-
Mongo
-
-
-
4.x
Alibaba Graph Database
-
-
-
-
-
Only Script Mode supported
Cloud Message Queue
Kafka
2.4.1,2.7.1,2.8.1,2.8.2 (including Kafka, Ckafka data sources)
TDMQ Pulsar
-
-
-
-
-
-
Virtual Cluster Edition
TiDB-Kafka
-
-
-
-
-
-
-
DTS-kafka
-
-
-
-
-
-
-
Data Reporting
SDK
-
-
-
-
-
-
-
TKE
-
-
-
-
-
-
-
CVM
-
-
-
-
-
-
-
Note:
Data link read/write ends must meet the corresponding data source versions.