Can't connect to brocker with examples consumer/producer #4707

jchapon · 2024-05-06T15:25:46Z

jchapon
May 6, 2024

Hello all,

I'm trying to use rdkafka (2.3.0) with a brocker and KRaft (3.7.0) but it ended each time with "1/1 brokers are down" with the 2 examples producer or consumer after the ApiVersionRequest .

%7|1715005598.763|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.763|METADATA|rdkafka#producer-1| localhost:9092/bootstrap: Request metadata for brokers only: connected
%7|1715005598.764|FAIL|rdkafka#producer-1| localhost:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP) (_TRANSPORT)
%3|1715005598.764|FAIL|rdkafka#producer-1| localhost:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP)
%7|1715005598.764|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state UP -> DOWN

It's working fine with kafka-console-producer.sh and kafka-console-consumer.sh from the kafka package.

Any ideas ?

Thanks in advance

full log from the producer :

%7|1715005598.744|BRKMAIN|rdkafka#producer-1| :0/internal: Enter main broker thread
%7|1715005598.744|WAKEUPFD|rdkafka#producer-1| localhost:9092/bootstrap: Enabled low-latency ops queue wake-ups
%7|1715005598.745|BROKER|rdkafka#producer-1| localhost:9092/bootstrap: Added new broker with NodeId -1
%7|1715005598.745|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Selected for cluster connection: bootstrap servers added (broker has 0 connection attempt(s))
%7|1715005598.745|INIT|rdkafka#producer-1| librdkafka v2.3.0 (0x20300ff) rdkafka#producer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_gssapi,sasl_plain,sasl_scram,plugins,sasl_oauthbearer,http,oidc, CMAKE GNU  PKGCONFIG HDRHISTOGRAM ZLIB CURL LIBDL PLUGINS SSL C11THREADS SNAPPY SOCKEM, debug 0xfffff)
%7|1715005598.745|CONF|rdkafka#producer-1| Client configuration:
%7|1715005598.745|CONF|rdkafka#producer-1|   client.software.version = 2.3.0
%7|1715005598.745|CONF|rdkafka#producer-1|   metadata.broker.list = localhost:9092
%7|1715005598.745|CONF|rdkafka#producer-1|   debug = generic,broker,topic,metadata,feature,queue,msg,protocol,cgrp,security,fetch,interceptor,plugin,consumer,admin,eos,mock,assignor,conf,all
%7|1715005598.745|CONF|rdkafka#producer-1|   log_level = 7
%7|1715005598.745|CONF|rdkafka#producer-1|   dr_msg_cb = 1100aeae8
% Type some text and hit enter to produce message
% Or just hit enter to only serve delivery reports
% Press Ctrl-C or Ctrl-D to exit
%7|1715005598.746|BRKMAIN|rdkafka#producer-1| localhost:9092/bootstrap: Enter main broker thread
%7|1715005598.746|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Received CONNECT op
%7|1715005598.746|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state INIT -> TRY_CONNECT
%7|1715005598.746|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.746|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: broker in state TRY_CONNECT connecting
%7|1715005598.747|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state TRY_CONNECT -> CONNECT
%7|1715005598.747|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.749|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Connecting to ipv4#127.0.0.1:9092 (plaintext) with socket 7
%7|1715005598.749|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Connected to ipv4#127.0.0.1:9092
%7|1715005598.749|CONNECTED|rdkafka#producer-1| localhost:9092/bootstrap: Connected (#1)
%7|1715005598.749|FEATURE|rdkafka#producer-1| localhost:9092/bootstrap: Updated enabled protocol features +ApiVersion to ApiVersion
%7|1715005598.749|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state CONNECT -> APIVERSION_QUERY
%7|1715005598.749|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.749|SEND|rdkafka#producer-1| localhost:9092/bootstrap: Sent ApiVersionRequest (v3, 40 bytes @ 0, CorrId 1)
%7|1715005598.754|RECV|rdkafka#producer-1| localhost:9092/bootstrap: Received ApiVersionResponse (v3, 467 bytes, CorrId 1, rtt 4.74ms)
%7|1715005598.754|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Broker API support:
%7|1715005598.754|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Produce (0) Versions 0..10
%7|1715005598.754|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Fetch (1) Versions 0..16
%7|1715005598.754|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ListOffsets (2) Versions 0..8
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Metadata (3) Versions 0..12
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey OffsetCommit (8) Versions 0..9
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey OffsetFetch (9) Versions 0..9
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey FindCoordinator (10) Versions 0..4
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey JoinGroup (11) Versions 0..9
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Heartbeat (12) Versions 0..4
%7|1715005598.755|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey LeaveGroup (13) Versions 0..5
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey SyncGroup (14) Versions 0..5
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeGroups (15) Versions 0..5
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ListGroups (16) Versions 0..4
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey SaslHandshake (17) Versions 0..1
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ApiVersion (18) Versions 0..3
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey CreateTopics (19) Versions 0..7
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DeleteTopics (20) Versions 0..6
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DeleteRecords (21) Versions 0..2
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey InitProducerId (22) Versions 0..4
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey OffsetForLeaderEpoch (23) Versions 0..4
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AddPartitionsToTxn (24) Versions 0..4
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AddOffsetsToTxn (25) Versions 0..3
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey EndTxn (26) Versions 0..3
%7|1715005598.756|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey WriteTxnMarkers (27) Versions 0..1
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey TxnOffsetCommit (28) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeAcls (29) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey CreateAcls (30) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DeleteAcls (31) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeConfigs (32) Versions 0..4
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AlterConfigs (33) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AlterReplicaLogDirs (34) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeLogDirs (35) Versions 0..4
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey SaslAuthenticate (36) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey CreatePartitions (37) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey CreateDelegationToken (38) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey RenewDelegationToken (39) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ExpireDelegationToken (40) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeDelegationToken (41) Versions 0..3
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DeleteGroups (42) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ElectLeadersRequest (43) Versions 0..2
%7|1715005598.757|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey IncrementalAlterConfigsRequest (44) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AlterPartitionReassignmentsRequest (45) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ListPartitionReassignmentsRequest (46) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey OffsetDeleteRequest (47) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeClientQuotasRequest (48) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AlterClientQuotasRequest (49) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeUserScramCredentialsRequest (50) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey AlterUserScramCredentialsRequest (51) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeQuorumRequest (55) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey UpdateFeaturesRequest (57) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeCluster (60) Versions 0..1
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeProducers (61) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey UnregisterBroker (64) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey DescribeTransactions (65) Versions 0..0
%7|1715005598.758|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey ListTransactions (66) Versions 0..0
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Unknown-68? (68) Versions 0..0
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:   ApiKey Unknown-74? (74) Versions 0..0
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature MsgVer1: Produce (2..2) supported by broker
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature MsgVer1: Fetch (2..2) supported by broker
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature MsgVer1
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature MsgVer2: Produce (3..3) supported by broker
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature MsgVer2: Fetch (4..4) supported by broker
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature MsgVer2
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature ApiVersion: ApiVersion (0..0) supported by broker
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature ApiVersion
%7|1715005598.761|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerGroupCoordinator: FindCoordinator (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature BrokerGroupCoordinator
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: FindCoordinator (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature BrokerBalancedConsumer
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature ThrottleTime: Produce (1..2) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature ThrottleTime: Fetch (1..2) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature ThrottleTime
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature Sasl: JoinGroup (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature Sasl
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature SaslHandshake: SaslHandshake (0..0) supported by broker
%7|1715005598.762|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature SaslHandshake
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature LZ4: FindCoordinator (0..0) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature LZ4
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature OffsetTime: ListOffsets (1..1) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature OffsetTime
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature IdempotentProducer: InitProducerId (0..0) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature IdempotentProducer
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature ZSTD: Produce (7..7) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature ZSTD: Fetch (10..10) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature ZSTD
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature SaslAuthReq: SaslHandshake (1..1) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap:  Feature SaslAuthReq: SaslAuthenticate (0..1) supported by broker
%7|1715005598.763|APIVERSION|rdkafka#producer-1| localhost:9092/bootstrap: Enabling feature SaslAuthReq
%7|1715005598.763|FEATURE|rdkafka#producer-1| localhost:9092/bootstrap: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4,OffsetTime,MsgVer2,IdempotentProducer,ZSTD,SaslAuthReq
%7|1715005598.763|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state APIVERSION_QUERY -> UP
%7|1715005598.763|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.763|METADATA|rdkafka#producer-1| localhost:9092/bootstrap: Request metadata for brokers only: connected
%7|1715005598.764|FAIL|rdkafka#producer-1| localhost:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP) (_TRANSPORT)
%3|1715005598.764|FAIL|rdkafka#producer-1| localhost:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP)
%7|1715005598.764|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state UP -> DOWN
%3|1715005598.764|ERROR|rdkafka#producer-1| 1/1 brokers are down
%7|1715005598.764|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.764|BUFQ|rdkafka#producer-1| localhost:9092/bootstrap: Purging bufq with 0 buffers
%7|1715005598.764|BUFQ|rdkafka#producer-1| localhost:9092/bootstrap: Purging bufq with 1 buffers
%7|1715005598.764|BUFQ|rdkafka#producer-1| localhost:9092/bootstrap: Updating 0 buffers on connection reset
%7|1715005598.765|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state DOWN -> INIT
%7|1715005598.765|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.765|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state INIT -> TRY_CONNECT
%7|1715005598.765|BROADCAST|rdkafka#producer-1| Broadcasting state change
%7|1715005598.765|RECONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Delaying next reconnect by 156ms
%7|1715005598.765|REQERR|rdkafka#producer-1| localhost:9092/bootstrap: MetadataRequest failed: Local: Broker transport failure: actions Retry
%7|1715005598.768|RETRY|rdkafka#producer-1| localhost:9092/bootstrap: Retrying MetadataRequest (v12, 26 bytes, retry 0/2, prev CorrId 0) in 100ms
%7|1715005598.768|RECONNECT|rdkafka#producer-1| localhost:9092/bootstrap: Delaying next reconnect by 153ms
%7|1715005598.865|RETRY|rdkafka#producer-1| localhost:9092/bootstrap: Moved 1 retry buffer(s) to output queue
%7|1715005598.925|CONNECT|rdkafka#producer-1| localhost:9092/bootstrap: broker in state TRY_CONNECT connecting
%7|1715005598.925|STATE|rdkafka#producer-1| localhost:9092/bootstrap: Broker changed state TRY_CONNECT -> CONNECT
...

Answered by JiriNovakCSSoft

May 20, 2024

Hi, I am struggling with same issue right now. I have compiled librdkafka 2.4.0 on my AIX 7.2 and rdkafka_example gives me the same error:

librdkafka-2.4.0/examples> ./rdkafka_example -P -t aix_topic -b kafka:9092

1716205391.433 RDKAFKA-3-FAIL: rdkafka#producer-1: [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP)
1716205391.433 RDKAFKA-3-ERROR: rdkafka#producer-1: [thrd:kafka:9092/bootstrap]: 1/1 brokers are down

After some debugging, I have found out, that AIX has the same issue with errno setting like SUN. AIX "me too" section below fixed it.

src/rdkafka_transport.c

#ifdef __sun
        /* SunOS doesn't seem to set errno when recvmsg() fa…

View full answer

JiriNovakCSSoft · 2024-05-20T12:05:01Z

JiriNovakCSSoft
May 20, 2024

Hi, I am struggling with same issue right now. I have compiled librdkafka 2.4.0 on my AIX 7.2 and rdkafka_example gives me the same error:

librdkafka-2.4.0/examples> ./rdkafka_example -P -t aix_topic -b kafka:9092

1716205391.433 RDKAFKA-3-FAIL: rdkafka#producer-1: [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Receive failed: Error 0 (after 0ms in state UP)
1716205391.433 RDKAFKA-3-ERROR: rdkafka#producer-1: [thrd:kafka:9092/bootstrap]: 1/1 brokers are down

After some debugging, I have found out, that AIX has the same issue with errno setting like SUN. AIX "me too" section below fixed it.

src/rdkafka_transport.c

#ifdef __sun
        /* SunOS doesn't seem to set errno when recvmsg() fails
         * due to no data and MSG_DONTWAIT is set. */
        rd_socket_errno = EAGAIN;
#endif
#ifdef _AIX
        /* AIX me too */
        rd_socket_errno = EAGAIN;
#endif
        r = recvmsg(rktrans->rktrans_s, &msg, MSG_DONTWAIT);

To be correct, I fixed also sendmsg case.

#ifdef __sun
        /* See recvmsg() comment. Setting it here to be safe. */
        rd_socket_errno = EAGAIN;
#endif
#ifdef _AIX
        rd_socket_errno = EAGAIN;
#endif
        r = sendmsg(rktrans->rktrans_s, &msg,
                    MSG_DONTWAIT
#ifdef MSG_NOSIGNAL
                        | MSG_NOSIGNAL
#endif
        );

1 reply

jchapon May 21, 2024
Author

Hello,

Thanks for the help.
It works now.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Can't connect to brocker with examples consumer/producer #4707

{{title}}

Replies: 1 comment 1 reply

{{title}}

{{title}}

Select a reply

Can't connect to brocker with examples consumer/producer #4707

jchapon May 6, 2024

Replies: 1 comment · 1 reply

JiriNovakCSSoft May 20, 2024

jchapon May 21, 2024 Author

jchapon
May 6, 2024

Replies: 1 comment 1 reply

JiriNovakCSSoft
May 20, 2024

jchapon May 21, 2024
Author