DataInLong provides real-time writing capabilities for StarRocks. This article introduces the current support status for StarRocks real-time data synchronization.
Supported Versions
Currently, DataInLong supports database-level real-time writing to StarRocks. Using the real-time writing capability requires compliance with the following version limitations:
Type | Version |
StarRocks | 2.5.3,3.1.2,3.1.12 |
Use Limits
DDL changes do not support modifying field names. If the source end modifies a field name, automatic modification of the field name on the StarRocks target end is not supported.
Importing using CSV format is not supported.
Advanced parameters are not supported.
Real-time whole database writing configuration
Supported Data Sources
Currently, the following source types of data are supported for real-time, database-level synchronization to the StarRocks target end:
Data Target Configuration
Parameter | Description |
Data Flow Direction | Select the target data source for synchronization. |
Database/Table Matching Strategy | Name matching rules for databases and data table objects in StarRocks: Default to the same name as the source database/source table. Self Definition: Supports generating target database and table names using built-in parameters and string combinations. Note Example: If the source table name is table1, and the mapping rule is ${table_name_di_src}_inlong, then the data from table1 will eventually be mapped and written into table1_inlong. |
Data Type Conversion Supported
Flink data type | StarRocks data type |
BOOLEAN | BOOLEAN |
TINYINT | TINYINT |
SMALLINT | SMALLINT |
INTEGER | INTEGER |
BIGINT | BIGINT |
FLOAT | FLOAT |
DOUBLE | DOUBLE |
DECIMAL | DECIMAL |
BINARY | INT |
CHAR | STRING |
VARCHAR | STRING |
STRING | STRING |
DATE | DATE |
TIMESTAMP_WITHOUT_TIME_ZONE(N) | DATETIME |
TIMESTAMP_WITH_LOCAL_TIME_ZONE(N) | DATETIME |
ARRAY<T> | ARRAY<T> |
MAP<KT,VT> | JSON STRING |
ROW<arg T...> | JSON STRING |