CKafka Connector is a SaaS-based data access and processing tool on Tencent Cloud, enabling seamless one-stop data integration, processing, and distribution. The connector offers SDKs based on HTTP/TCP protocols to help customers quickly report data, subscribe to and store change information from various databases (MySQL, PostgreSQL, MongoDB, etc.) using the CDC (Change Data Capture) mechanism, and integrate logs from multiple cloud services. Additionally, it provides easily configurable data cleansing (ETL) capabilities and a wide range of data output channels, assisting customers in building cost-effective data flow links and bridging the gap between data sources and processing systems.
By going SaaS, CKafka Connector allows you to connect data in and off the cloud in cross-cloud and hybrid cloud scenarios. It comes with low-cost data flow capabilities that are simple to configure, helping you create a reliable and stable data linkage.
Features
Data Reporting
CKafka Connector offers client SDKs based on HTTP/TCP protocols to easily report data to various message queue services such as CKafka, TDMQ for Pulsar, and TDMQ for RocketMQ. It simplifies the data reporting process and completes data reporting in a SaaS manner, freeing you from developing and maintaining data reporting servers as well as learning the complex protocols of message queues.
Database change subscription
CKafka Connector supports subscribing to change data from various databases using the CDC (Change Data Capture) mechanism. Examples include subscribing to MySQL's Binlog, MongoDB's Change Stream, PostgreSQL's Row-level Change, and SQL Server's Row-level Change. These data subscriptions are sent to message queues, making it convenient for businesses to process, distribute, and query the data.
Data integration from various data sources
CKafka Connector opens up data connections in public cloud, cross-cloud, and hybrid cloud scenarios such as log, database, middleware, and HTTP. It can integrate logs from multiple Tencent Cloud services as well as data from your self-built sources and other clouds.
Data ETL and distribution
After data is reported to the message queue, CKafka Connector offers powerful visual data ETL configuration capabilities to conveniently and quickly ETL, format, and convert data and then dump the output data to downstream systems.
Custom serverless processing
By leveraging the strengths of the serverless platform and the pay-as-you-go billing and code customization capabilities of SCF, CKafka Connector allows you to write business logic based on functions for customized data processing and distribution.
