Program received signal SIGPIPE, Broken pipe. #2

rngadam · 2013-01-07T13:00:46Z

I'm getting the following when trying the example on Ubuntu 12.10:
f
Kafka 0.7.2 (installed from https://github.com/downloads/wmf-analytics/kafka-debian/kafka_0.7.2_all.deb)

Program received signal SIGPIPE, Broken pipe.
[Switching to Thread 0xb7dc8b40 (LWP 8168)]
0xb7fdd424 in __kernel_vsyscall ()
(gdb) bt
#0  0xb7fdd424 in __kernel_vsyscall ()
#1  0xb7fabf08 in sendmsg () from /lib/i386-linux-gnu/libpthread.so.0
#2  0x0804a7ca in rd_kafka_send (rk=0x80518f8, msg=<optimized out>)
    at rdkafka.c:413
#3  0x0804a95a in rd_kafka_send_request (rk=rk@entry=0x80518f8, 
    msgtype=msgtype@entry=0, topicpart=0xb7dc7124) at rdkafka.c:477
#4  0x0804aca6 in rd_kafka_produce_send (rko=0x8051d70, rk=0x80518f8)
    at rdkafka.c:862
#5  rd_kafka_wait_op (rk=<optimized out>) at rdkafka.c:909
#6  rd_kafka_thread_main (arg=0x80518f8) at rdkafka.c:984
#7  0xb7fa4d4c in start_thread () from /lib/i386-linux-gnu/libpthread.so.0
#8  0xb7ec0d3e in clone () from /lib/i386-linux-gnu/libc.so.6

The text was updated successfully, but these errors were encountered:

rngadam · 2013-01-07T13:32:48Z

...due to permissions problem with the logs directory (running process as kafka, directory owned by $USER).

…n if connection drops. (issue #2)

edenhill · 2013-01-07T20:31:35Z

Thanks for pointing this out, the example program and documentation shouldve mentioned blocking SIGPIPE.
Its fixed now.

Port to BoringSSL

TSan report (founded by ClickHouse CI): Exception: Sanitizer assert found for instance �================== WARNING: ThreadSanitizer: data race (pid=1) Read of size 8 at 0x7b7800127158 by thread T987 (mutexes: read M0, write M1, write M2): #0 __tsan_memcpy <null> (clickhouse+0x74eebb7) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#1 rd_avg_rollover build_docker/./contrib/librdkafka/src/rdavg.h:153:22 (clickhouse+0x1e39753b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#2 rd_kafka_stats_emit_avg build_docker/./contrib/librdkafka/src/rdkafka.c:1354:9 (clickhouse+0x1e39753b) confluentinc#3 rd_kafka_stats_emit_all build_docker/./contrib/librdkafka/src/rdkafka.c:1717:17 (clickhouse+0x1e395c8b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#4 rd_kafka_stats_emit_tmr_cb build_docker/./contrib/librdkafka/src/rdkafka.c:1898:2 (clickhouse+0x1e395c8b) confluentinc#5 rd_kafka_timers_run build_docker/./contrib/librdkafka/src/rdkafka_timer.c:288:4 (clickhouse+0x1e46498a) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#6 rd_kafka_thread_main build_docker/./contrib/librdkafka/src/rdkafka.c:2021:3 (clickhouse+0x1e3919e9) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#7 _thrd_wrapper_function build_docker/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x1e47a57b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) Previous write of size 8 at 0x7b7800127158 by thread T986: #0 rd_avg_calc build_docker/./contrib/librdkafka/src/rdavg.h:104:38 (clickhouse+0x1e37d71d) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#1 rd_kafka_broker_timeout_scan build_docker/./contrib/librdkafka/src/rdkafka_broker.c:880:25 (clickhouse+0x1e37d71d) confluentinc#2 rd_kafka_broker_ops_io_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:3416:17 (clickhouse+0x1e37d71d) confluentinc#3 rd_kafka_broker_consumer_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:4975:17 (clickhouse+0x1e378e5e) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#4 rd_kafka_broker_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:5080:17 (clickhouse+0x1e378e5e) confluentinc#5 rd_kafka_broker_thread_main build_docker/./contrib/librdkafka/src/rdkafka_broker.c:5237:25 (clickhouse+0x1e372619) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#6 _thrd_wrapper_function build_docker/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x1e47a57b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) Refs: ClickHouse/ClickHouse#60443

TSan report (founded by ClickHouse CI): Exception: Sanitizer assert found for instance �================== WARNING: ThreadSanitizer: data race (pid=1) Read of size 8 at 0x7b7800127158 by thread T987 (mutexes: read M0, write M1, write M2): #0 __tsan_memcpy <null> (clickhouse+0x74eebb7) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#1 rd_avg_rollover build_docker/./contrib/librdkafka/src/rdavg.h:153:22 (clickhouse+0x1e39753b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#2 rd_kafka_stats_emit_avg build_docker/./contrib/librdkafka/src/rdkafka.c:1354:9 (clickhouse+0x1e39753b) confluentinc#3 rd_kafka_stats_emit_all build_docker/./contrib/librdkafka/src/rdkafka.c:1717:17 (clickhouse+0x1e395c8b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#4 rd_kafka_stats_emit_tmr_cb build_docker/./contrib/librdkafka/src/rdkafka.c:1898:2 (clickhouse+0x1e395c8b) confluentinc#5 rd_kafka_timers_run build_docker/./contrib/librdkafka/src/rdkafka_timer.c:288:4 (clickhouse+0x1e46498a) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#6 rd_kafka_thread_main build_docker/./contrib/librdkafka/src/rdkafka.c:2021:3 (clickhouse+0x1e3919e9) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#7 _thrd_wrapper_function build_docker/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x1e47a57b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) Previous write of size 8 at 0x7b7800127158 by thread T986: #0 rd_avg_calc build_docker/./contrib/librdkafka/src/rdavg.h:104:38 (clickhouse+0x1e37d71d) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#1 rd_kafka_broker_timeout_scan build_docker/./contrib/librdkafka/src/rdkafka_broker.c:880:25 (clickhouse+0x1e37d71d) confluentinc#2 rd_kafka_broker_ops_io_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:3416:17 (clickhouse+0x1e37d71d) confluentinc#3 rd_kafka_broker_consumer_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:4975:17 (clickhouse+0x1e378e5e) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#4 rd_kafka_broker_serve build_docker/./contrib/librdkafka/src/rdkafka_broker.c:5080:17 (clickhouse+0x1e378e5e) confluentinc#5 rd_kafka_broker_thread_main build_docker/./contrib/librdkafka/src/rdkafka_broker.c:5237:25 (clickhouse+0x1e372619) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) confluentinc#6 _thrd_wrapper_function build_docker/./contrib/librdkafka/src/tinycthread.c:576:9 (clickhouse+0x1e47a57b) (BuildId: 7122171f6a93acda7ea89a6d10cce3ad580a715d) Refs: ClickHouse/ClickHouse#60443 Refs: ClickHouse/ClickHouse#60939 Refs: confluentinc#4625

rngadam closed this as completed Jan 7, 2013

edenhill pushed a commit that referenced this issue Jan 7, 2013

Calling application must ignore or handle SIGPIPE to avoid terminatio…

c15c314

…n if connection drops. (issue #2)

eugpermar mentioned this issue Aug 10, 2013

Cannot send messages when the topic is set long time after the broker #16

Closed

xiaojun789 mentioned this issue Nov 8, 2013

crashes on too large messages #24

Closed

winbatch mentioned this issue Dec 27, 2013

static linking of librdkafka.a needs dynamic pthreads linking #34

Closed

winbatch mentioned this issue Jan 27, 2014

No error callback and hanging when publishing to non existent partition #39

Closed

winbatch mentioned this issue Feb 5, 2014

Crash on exit #72

Closed

winbatch mentioned this issue Mar 18, 2014

rdkafka_performance crashes with -o 'beginning' #92

Closed

FrankVanYoung mentioned this issue Mar 31, 2014

rkb->rkb_fetching > 0 error #84

Closed

xhcqwlgithub mentioned this issue Jun 25, 2014

Segmentation fault when creating producer #125

Closed

laxpio mentioned this issue Aug 4, 2014

Crash on invalid partition in Metadata #132

Closed

desmondhe mentioned this issue Sep 3, 2014

dead-lock in multi-thread enviroment #145

Closed

winbatch mentioned this issue Sep 10, 2014

Difference between isr info from librdkafka vs kafka-list-topic.sh #147

Closed

laxpio mentioned this issue Oct 9, 2014

Crash on rd_kafka_topic_metadata_update #155

Closed

affranchi mentioned this issue Mar 26, 2015

Seg fault with multi brokers #224

Closed

bbgasj mentioned this issue Mar 27, 2015

The problem of "broker" offset store method #225

Closed

mahb94 mentioned this issue Apr 21, 2015

client consume from kafka crushed occasionally #254

Closed

edenhill mentioned this issue Jun 8, 2015

2 races conditions #281

Closed

rathdeep mentioned this issue Jul 3, 2015

Best approach to read messages from multiple topics or partitions #322

Closed

chenzhanyiczy mentioned this issue Jul 7, 2015

Deadlock on broker restart #326

Closed

This was referenced Jul 13, 2015

rdkafka can't be built with native compilers #319

Closed

librdkafka does not compile cleanly on AIX (using gcc/g++) #328

Closed

sh9189 mentioned this issue Jul 29, 2015

librdkafka tests crash on solaris #340

Closed

adityanahan mentioned this issue Aug 8, 2015

Rdkafka Failed to detect broker state #346

Closed

chriscrenshaw mentioned this issue Aug 14, 2015

rd_kafka_buf_destroy() always aborts - causing an immediate crash of the consumer app #353

Closed

ylgeeker mentioned this issue Aug 28, 2015

rd_kafka_topic_destroy0 will crash ?? @ 0.8.6 #360

Closed

DEvil0000 mentioned this issue Oct 12, 2015

rdkafka stopping connection retries on RdKafka::ERR__ALL_BROKERS_DOWN #373

Closed

jimmy1911 mentioned this issue Oct 29, 2015

Receive failed from one broker causes coredump #396

Closed

sarkanyi mentioned this issue Sep 9, 2019

Recovery takes too long after stopping and restarting a broker in a cluster #2508

Closed

3 tasks

kerenor23 mentioned this issue Sep 11, 2019

[Question] New Consumer+Producer randomly fails to access broker #2519

Closed

hyhtemple mentioned this issue Oct 14, 2019

use the produce of the librdkafka c++ interface ,the program report "Program terminated with signal 6, Aborted" #2571

Closed

hyhtemple mentioned this issue Oct 22, 2019

the program of the Consumer crashed when create topic #2579

Closed

hqthao-ts mentioned this issue Oct 24, 2019

Broker with Kerberos: some produce calls took 1 minute to finish #2587

Closed

7 tasks

aelanthi mentioned this issue Dec 16, 2019

confluent python kafka client still crashes after 1.0.1 upgrade #2658

Closed

7 tasks

JoakimBlach mentioned this issue Apr 30, 2020

[Question] Understanding "1 request(s) timed out: disconnect" #2845

Closed

7 tasks

hyhtemple mentioned this issue Jun 30, 2020

It is crashed ,when use method of the producer in the thread #2947

Closed

dshivashankar1994 mentioned this issue Jul 6, 2020

rd_refcnt_sub0: Assertion `!*"refcnt sub-zero"' failed - when the subscribed topic is deleted #2963

Closed

waitingF mentioned this issue Jul 24, 2020

rd_kafka_destroy() hang on #3007

Closed

7 tasks

Lasuerte mentioned this issue Jul 24, 2020

producer can not produce message unless restarted after the broker restarted #3009

Closed

7 tasks

Furuta-Masakazu-quick mentioned this issue Sep 29, 2020

Producer detects "All broker connections are down" when rolling restarts #3090

Closed

7 tasks

azat pushed a commit to azat-archive/librdkafka that referenced this issue Dec 13, 2020

Merge pull request confluentinc#2 from ClickHouse-Extras/boringssl

fc0676f

Port to BoringSSL

davinnfld mentioned this issue Jan 8, 2021

Question: sending single message with no delay #3202

Closed

nagendrababupv mentioned this issue Mar 21, 2021

Duplicate message from RDKafka #3311

Closed

7 tasks

taj-uddin mentioned this issue Apr 15, 2021

High CPU usage in librdkafka1.4.0 producer #2986

Closed

7 tasks

johncagle mentioned this issue Sep 22, 2021

segfault in rd_kafka_msgq_set_metadata() from /lib64/librdkafka.so.1 (corrupt TAILQ) #3559

Open

7 tasks

kenlee1988 mentioned this issue Nov 18, 2021

rd_kafka_clustid does not return until timeout when kafka has no topic #3620

Open

7 tasks

eelyaj mentioned this issue Nov 22, 2021

Throughput decrease badly while broker number increase. #3626

Open

7 tasks

yxuechao007 mentioned this issue Nov 26, 2021

RdKafka::Producer parses aws kafka broker reporting segment errors when the cluster information is retrieved after a few minutes #3632

Open

acoredump mentioned this issue Dec 15, 2021

coredump in producer::poll #3647

Closed

yuanhongduan mentioned this issue Dec 27, 2021

librdkafka deadlock at cnd_timedwait when destroy the consumer #3660

Open

mhowlett mentioned this issue Sep 19, 2022

Transactional producer fixes #3971

Merged

mreouven mentioned this issue Nov 9, 2023

Thread 15 "rdk:broker-1" received signal SIGSEGV, Segmentation fault. #1054 #4505

Open

chunaiarun mentioned this issue Aug 29, 2024

timeout issue with async commit , we want to commit every message after consuming #4827

Closed

thmic mentioned this issue Nov 29, 2024

segmentation fault from rdkafka_topic.c #4907

Open

7 tasks

thilinak mentioned this issue Dec 12, 2024

C++ application built with librdkafka with GCC TSAN crashes when starting #4929

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Program received signal SIGPIPE, Broken pipe. #2

Program received signal SIGPIPE, Broken pipe. #2

rngadam commented Jan 7, 2013

rngadam commented Jan 7, 2013

edenhill commented Jan 7, 2013

Program received signal SIGPIPE, Broken pipe. #2

Program received signal SIGPIPE, Broken pipe. #2

Comments

rngadam commented Jan 7, 2013

rngadam commented Jan 7, 2013

edenhill commented Jan 7, 2013