环境准备
[hadoop@hadoop04 ~]tar -zxvf /opt/soft/kafka_2.11-0.10.2.1.tgz -C /opt/apps/
[hadoop@hadoop01 ~]$ cd /opt/apps/kafka_2.11-0.10.2.1/config/
[hadoop@hadoop01 config]$ vim server.properties
# 以下3个配置是需要修改的,其余保持默认即可
broker.id=11
log.dirs=/opt/data/kafka/broker11
zookeeper.connect=hadoop01:2181,hadoop02:2181,hadoop03:2181
说明:
[hadoop@hadoop04 config]$ mkdir -p /opt/data/kafka
[hadoop@hadoop01 ~]$ zkServer.sh start
[hadoop@hadoop02 ~]$ zkServer.sh start
[hadoop@hadoop03 ~]$ zkServer.sh start
[hadoop@hadoop04 kafka_2.11-0.10.2.1]$ bin/kafka-server-start.sh -daemon config/server.properties
# -daemon选项的意思是后台启动服务
[hadoop@hadoop04 kafka_2.11-0.10.2.1]$ jps
2340 Jps
2286 Kafka
[hadoop@hadoop01 ~]$ zkCli.sh
[zk: localhost:2181(CONNECTED) 2] ls /brokers/ids
[11]
Kafka 单节点搭建成功!
所谓Kafka伪分布式,就是一个节点启动多个Kafka服务,只需要新增加server.properties配置文件,并按照新的配置文件再启动一个服务即可,当然数量可以看自己心情,我这里就再启动一个kafka服务
[hadoop@hadoop04 config]$ cp server.properties server-2.properties
[hadoop@hadoop04 config]$ vim server-2.properties
broker.id=12
port=9093
log.dirs=/opt/data/kafka/broker12
说明:
[hadoop@hadoop04 kafka_2.11-0.10.2.1]$ bin/kafka-server-start.sh -daemon config/server-2.properties
注意:启动Kafka集群之前一定要先启动zookeeper集群,我上面已经启动了zookeeper集群,所以这里没有再启
[hadoop@hadoop04 kafka_2.11-0.10.2.1]$ jps
22485 Jps
22461 Kafka
2286 Kafka
1982 QuorumPeerMain
可以看到,启动了两个Kafka服务
[zk: localhost:2181(CONNECTED) 3] ls /brokers/ids
[11, 12]
Kafka伪分布式集群搭建成功!