CKafka supports automatic adjustment of the disk utilization. After the disk utilization reaches the threshold, you can set the Dynamic Message Retention Policy to reduce the message retention time or set the Automatic Disk Capacity Expansion to adjust the disk space.
Dynamic Message Retention: After setting the message retention time, expired messages will be deleted. In case of a sudden increase in user messages, normal production and consumption cannot occur once the disk space is full. By implementing a dynamic data retention policy, when the disk space utilization reaches a certain percentage, a proportion of data will automatically expire, preventing the aforementioned situation from occurring.
Automatic Disk Capacity Expansion: When the disk load gets heavy, messages cannot be produced and consumed normally. After the automatic disk capacity expansion policy is set, when the disk load reaches the trigger threshold, the disk capacity will be automatically adjusted according to the policy, thus avoiding this problem.
Policy types
Supported by CKafka Standard Edition
Supported by CKafka Pro Edition
Dynamic message retention
Supported
Supported
Disk Utilization Policy
Not required
Supported
Note
You can enable either dynamic message retention or automatic disk capacity expansion at any time.
2. Click on Instance List in the left navigation bar, then click on the "ID/Name" of the target instance to enter the Basic Information page.
3. Select the Smart Ops tab at the top of the page, then choose the Auto Scaling tab, and configure the disk space adjustment policy in the Disk Utilization Policy module.
Configuring Disk Utilization Policy
Dynamic Message Retention Policy
Automatic Disk Capacity Expansion Policy
1. In the Disk Utilization Policy module, enable Dynamic Retention Policy.
Note
The default dynamic policy reduces the message retention time by 10% when the disk utilization reaches 75%.
2. Click on the Configure option in the Dynamic Retention Policy operation column to set the dynamic policy and the guaranteed duration.
Dynamic Policy: after message retention time adjustment is triggered, the broker will delete the oldest historical data according to the new retention time. This feature has a certain delay.
Minimum Retention Time: it can be 1 minute to 30 hours. If the dynamic retention time is lower than this parameter, no dynamic adjustment will be triggered.
3. Clicking on the View in the Adjustment Record column will redirect you to the Event Center to view the details of the automatic disk capacity expansion adjustment record.
1. In the Disk Utilization Processing module, enable Automatic Disk Capacity Expansion.
Note
By default, when the disk utilization reaches 75%, the disk capacity will be automatically expanded by 10%. The maximum disk capacity is determined by the current instance specifications, as displayed in the console.
2. Click on the Configuration in the Automatic Disk Capacity Expansion operation column to set the dynamic policy and maximum disk capacity.
Dynamic Policy: After the disk load reaches the trigger threshold, the disk capacity will be automatically adjusted according to the capacity expansion policy, with a certain delay.
Note
The disk capacity will be expanded in increments of 100 GB.
Maximum Disk Capacity: automatic disk capacity expansion will no longer be triggered after the disk capacity is expanded to this value.
3. Clicking on the View in the Adjustment Record column will redirect you to the Event Center to view the details of the automatic disk capacity expansion adjustment record.
