[Bug 815746] New: syslog-ng stops logging, "systemd-journal[249]: Forwarding to syslog missed 22 messages."
From what I can tell, there is only one thread running, so I 'm not sure how
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c0
Summary: syslog-ng stops logging, "systemd-journal[249]:
Forwarding to syslog missed 22 messages."
Classification: openSUSE
Product: openSUSE Factory
Version: 13.1 Milestone 0
Platform: Other
OS/Version: Other
Status: NEW
Severity: Major
Priority: P5 - None
Component: Basesystem
AssignedTo: bnc-team-screening@forge.provo.novell.com
ReportedBy: seife@novell.slipkontur.de
QAContact: qa-bugs@suse.de
CC: pczanik@genesi-usa.com
Found By: Third Party Developer/Partner
Blocker: ---
I don't know if this is a syslog-ng or a journald bug.
After some uptime, syslog-ng stops logging and journald starts to complain on a
regular base:
systemd-journal[249]: Forwarding to syslog missed 22 messages.
I attached GDB and got a backtrace:
(gdb) bt
#0 0x00007f82ed30a11c in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f82ed305f62 in _L_lock_1134 () from /lib64/libpthread.so.0
#2 0x00007f82ed305ee0 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f82ed5a34a1 in g_mutex_lock () from /usr/lib64/libglib-2.0.so.0
#4 0x00007f82ed858ce9 in ml_batched_timer_perform_update (self=0xe88db8) at
ml-batched-timer.c:45
#5 0x00007f82ed856abf in main_loop_call_handler (user_data=<optimized out>) at
mainloop.c:201
#6 0x00007f82ed870d7f in __iv_event_run_pending_events (_tinfo=0xe744e0) at
iv_event.c:58
#7 0x00007f82ed872559 in iv_event_raw_got_event (_this=0xe744e8) at
iv_event_raw_posix.c:89
#8 0x00007f82ed872be0 in iv_fd_poll_and_run (st=st@entry=0xe74470,
to=to@entry=0x7fff29f8c8a0) at iv_fd.c:163
#9 0x00007f82ed8735dc in iv_main () at iv_main_posix.c:117
#10 0x00007f82ed8576db in main_loop_run () at mainloop.c:736
#11 0x0000000000401715 in main (argc=1, argv=0x7fff29f8c9d8) at main.c:267
the lock can not be available, short of a programming error in syslog-ng.
(gdb) select 4
(gdb) list ml_batched_timer_perform_update
35 /* function called using main_loop_call() in case the suppress timer
needs
36 * to be updated. It is running in the main thread, thus is able to
37 * reregister our ivykis timer */
38 static void
39 ml_batched_timer_perform_update(MlBatchedTimer *self)
40 {
41 main_loop_assert_main_thread();
42
43 if (iv_timer_registered(&self->timer))
44 iv_timer_unregister(&self->timer);
(gdb)
45 g_static_mutex_lock(&self->lock);
46 self->timer.expires = self->expires;
47 self->updated = TRUE;
48 g_static_mutex_unlock(&self->lock);
49 if (self->timer.expires.tv_sec > 0)
50 iv_timer_register(&self->timer);
51 self->unref_cookie(self->cookie);
52 }
53
54 /*
(gdb) print self->lock
$1 = {mutex = 0x7f82dc00e580, unused = {__data = {__lock = 0, __count = 0,
__owner = 0, __nusers = 0, __kind =
0, __spins = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = '\000'
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c1
--- Comment #1 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c2
--- Comment #2 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c3
--- Comment #3 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c4
Cristian Rodríguez
Forwarded to internal mailing list. CzP from syslog-ng upstream....
Tell them to try to compile syslog-ng head with gcc 4.8 first using -fsanitize=address , you will find that the test suite crashes with .. ERROR: AddressSanitizer: global-buffer-overflow on address 0x00000041c365 at pc 0x7fcac0fa478b bp 0x7fffc9184f90 sp 0x7fffc9184f88... after fixing that, use -fsanitize=thread -pie -fpie to check for thread races, valgrind-tsan will also help.. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c
Philipp Thomas
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c5
peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c6
Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c7
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c8
--- Comment #8 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c9
--- Comment #9 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c10
--- Comment #10 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c11
--- Comment #11 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c12
--- Comment #12 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c13
--- Comment #13 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c14
--- Comment #14 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c15
--- Comment #15 from Marius Tomaschewski
-destination messages { file("/var/log/messages" suppress(30) owner(seife)> group(-1) perm(-1)); }; +destination messages { file("/var/log/messages" suppress(30) owner(-1) group(-1) perm(-1)); };
Is "seife" a user in /etc/passwd or perhaps a ldap (or other remote) user? When it is a not local one, this can cause a deadlock [e.g. getpwnam -> ldap-server -> syslog(3) on the log futex set in the glibc when the ldap- server runs on same machine]. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c16
--- Comment #16 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c17
--- Comment #17 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c18
--- Comment #18 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c19
Steffen Hau
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c20
--- Comment #20 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c21
--- Comment #21 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c22
--- Comment #22 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c23
--- Comment #23 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c24
--- Comment #24 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c25
--- Comment #25 from Swamp Workflow Management
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c26
--- Comment #26 from Stefan Seyfried
https://bugzilla.novell.com/show_bug.cgi?id=815746
https://bugzilla.novell.com/show_bug.cgi?id=815746#c27
peter czanik
participants (1)
-
bugzilla_noreply@novell.com