Apache Kafka 1.1.0 发布,改进 controller

Kafka 1.1.0 包含对了Controller 的重大改进,可以加快受控制部分的关闭。Zookeeper回话过期控制就属于此次升级的一部分

控制器改进还允许在 单个集群上支持更多的分区。kip-227引入增量获取请求,当分区的数量大,可以提供更有效的应答

KIP-113 added support for replica movement between log directories to enable data balancing with JBOD.

broker 的一些配置操作,比如 SSL keystores ,现在可以直接更新,而不用重启broker,详情请查看KIP-226

Delegation token based authentication (KIP-48) has been added to Kafka brokers to support large number of clients without overloading Kerberos KDCs or other authentication servers.

Several new features have been added to Kafka Connect, including header support (KIP-145), SSL and Kafka cluster identifiers in the Connect REST interface (KIP-208 and KIP-238), validation of connector names (KIP-212) and support for topic regex in sink connectors (KIP-215). Additionally, the default maximum heap size for Connect workers was increased to 2GB.

Several improvements have been added to the Kafka Streams API, including reducing repartition topic partitions footprint, customizable error handling for produce failures and enhanced resilience to broker unavailability. See KIPs 205, 210, 220, 224 and 239 for details.

  • 发表于:
  • 原文链接http://kuaibao.qq.com/s/20180330A0AUHK00?refer=cp_1026
  • 腾讯「云+社区」是腾讯内容开放平台帐号(企鹅号)传播渠道之一,根据《腾讯内容开放平台服务协议》转载发布内容。
  • 如有侵权,请联系 yunjia_community@tencent.com 删除。