Kafka + Zookeeper:无法建立到节点-1的连接。经纪人可能不可用

尼古拉·本:

我正在locahost中运行Zookeeper和Kafka(每个实例1个)。

我成功地从kafka创建了一个主题:

./bin/kafka-topics.sh --zookeeper localhost:2181 --create --replication-factor 1 --partitions 1 --topic Hello-Nicola

Created topic "Hello-Nicola".

Kafka日志显示:

[2017-12-06 16:00:17,753] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)
[2017-12-06 16:03:19,347] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Hello-Nicola-0 (kafka.server.ReplicaFetcherManager)
[2017-12-06 16:03:19,393] INFO Loading producer state from offset 0 for partition Hello-Nicola-0 with message format version 2 (kafka.log.Log)
[2017-12-06 16:03:19,406] INFO Completed load of log Hello-Nicola-0 with 1 log segments, log start offset 0 and log end offset 0 in 35 ms (kafka.log.Log)
[2017-12-06 16:03:19,408] INFO Created log for partition [Hello-Nicola,0] in /tmp/kafka-logs with properties {compression.type -> producer, message.format.version -> 1.0-IV0, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. (kafka.log.LogManager)
[2017-12-06 16:03:19,409] INFO [Partition Hello-Nicola-0 broker=0] No checkpointed highwatermark is found for partition Hello-Nicola-0 (kafka.cluster.Partition)
[2017-12-06 16:03:19,411] INFO Replica loaded for partition Hello-Nicola-0 with initial high watermark 0 (kafka.cluster.Replica)
[2017-12-06 16:03:19,413] INFO [Partition Hello-Nicola-0 broker=0] Hello-Nicola-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition)

但是Zookeeper日志显示:

2017-12-06 16:03:19,299 [myid:] - INFO  [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x1000177fb3d0001 type:create cxid:0x43 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/brokers/topics/Hello-Nicola/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/Hello-Nicola/partitions/0
2017-12-06 16:03:19,302 [myid:] - INFO  [ProcessThread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x1000177fb3d0001 type:create cxid:0x44 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/brokers/topics/Hello-Nicola/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/Hello-Nicola/partitions

如果我尝试产生消息:

./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic Hello-Nicola
>ciao
[2017-12-06 16:04:21,897] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)
[2017-12-06 16:04:22,000] WARN [Producer clientId=console-producer] Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient)

server.properties(在kafka中)为:

broker.id=0
listeners=PLAINTEXT://mylocal-0:9092
num.network.threads=3
num.io.threads=8
socket.send.buffer.bytes=102400
socket.receive.buffer.bytes=102400
socket.request.max.bytes=104857600
num.partitions=1
num.recovery.threads.per.data.dir=1
offsets.topic.replication.factor=1
transaction.state.log.replication.factor=1
transaction.state.log.min.isr=1
log.retention.hours=168
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
zookeeper.connect=localhost:2181
zookeeper.connection.timeout.ms=6000
group.initial.rebalance.delay.ms=0

似乎Zookeeper没有注册任何经纪人。

有什么建议吗?

尼古拉·本:

我发现了错误。服务器启动时观察Zookeeper日志,我注意到:

server.1=mylocal-0.:2888:3888

主机名后带有一个点(。)。

生成Zookeeper配置的脚本来自https://github.com/kubernetes/contrib/blob/master/statefulsets/zookeeper/zkGenConfig.sh

从内部看,我发现DOMAIN尚未填充:

HOST=`hostname -s`
DOMAIN=`hostname -d`

function print_servers() {
    for (( i=1; i<=$ZK_REPLICAS; i++ ))
    do
        echo "server.$i=$NAME-$((i-1)).$DOMAIN:$ZK_SERVER_PORT:$ZK_ELECTION_PORT"
    done
}

对于我的情况(本地主机),我不需要域,因此我删除了该变量。

现在,zookeeper和kafka可以正常通信。

本文收集自互联网,转载请注明来源。

如有侵权,请联系 [email protected] 删除。

编辑于
0

我来说两句

0 条评论
登录 后参与评论

相关文章

kafka管道的春季启动应用程序,错误为“无法建立到节点-1的连接。代理可能不可用。”

无法连接到Kafka经纪人

如果Kafka经纪人无法连接到Zookeeper,该怎么办?

无法启动本地Kafka经纪人

RabbitMQ + SpringAMPQ:经纪人不可用;启动期间无法强制执行队列声明:java.net.ConnectException:连接被拒绝:connect

无法启动kafka服务器/经纪人

Apache Kafka生产者经纪人连接

Spring Kafka-经纪人重新连接事件

Spring Kafka-经纪人重新连接事件

为KAFKA建立一个多经纪人集群并尝试杀死Leader Broker

经纪人不可用

为什么Kafka消费者连接到Zookeeper,而生产者却从经纪人那里获取元数据?

如何捕捉警告“经纪人可能不可用”,在春天卡夫卡监听器

kafka经纪人领导偏斜

Kafka + Spring本地代理可能不可用。Windows 10

Hyperledger Fabric 的 Kafka Brokers 无法建立连接

如何列出集群中所有可用的Kafka经纪人?

没有消费者连接时,Kafka经纪人可以保留消息吗?

通过TLS将Kafka生产者/消费者连接到经纪人

无法使用kafkajs连接到种子经纪人

即使经纪人破产,Kafka也会继续产生请求

处理kafka经纪人的完整磁盘空间

从我的局域网外部访问Kafka经纪人

为什么kafka消费者轮询经纪人?

如何覆盖Kafka经纪人的存储时间配置?

查找在Kafka集群中使用的经纪人ID

适用于Kafka经纪人的可行硬件

Kafka是否在经纪人集群之前支持ELB?

Kafka-经纪人:邮件大小过大