[Bug 719102] New: syslog-ng does not accept any messages
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c0
Summary: syslog-ng does not accept any messages
Classification: openSUSE
Product: openSUSE 12.1
Version: Factory
Platform: Other
OS/Version: Other
Status: NEW
Severity: Critical
Priority: P5 - None
Component: Basesystem
AssignedTo: mt@suse.com
ReportedBy: mmarek@suse.com
QAContact: qa@suse.de
CC: fcrozat@suse.com
Found By: ---
Blocker: ---
There are only syslong-ng generated messages in /var/log/messages and programs
hang when attempting to log something. As a result, it's not possible to ssh to
the machine.
# lsof /dev/log
lsof: WARNING: can't stat() fuse.gvfs-fuse-daemon file system
/home/mmarek/.gvfs
Output information may be incomplete.
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
systemd 1 root 21u unix 0xffff880221255440 0t0 4167 /dev/log
syslog-ng 797 root 3u unix 0xffff880221255440 0t0 4167 /dev/log
syslog-ng 798 root 3u unix 0xffff880221255440 0t0 4167 /dev/log
yet
# strace logger test
..
socket(PF_FILE, SOCK_DGRAM|SOCK_CLOEXEC, 0) = 1
connect(1, {sa_family=AF_FILE, path="/dev/log"}, 110) = 0
sendto(1, "<13>Sep 20 10:01:01 mmarek: test", 32, MSG_NOSIGNAL, NULL, 0^C
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c2
--- Comment #2 from Dr. Werner Fink
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c3
--- Comment #3 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c4
--- Comment #4 from Dr. Werner Fink
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c5
--- Comment #5 from Dr. Werner Fink
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c6
--- Comment #6 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c7
--- Comment #7 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c8
--- Comment #8 from Dr. Werner Fink
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c9
--- Comment #9 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c10
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c11
--- Comment #11 from Dr. Werner Fink
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c12
--- Comment #12 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c13
--- Comment #13 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c14
--- Comment #14 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c15
--- Comment #15 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c16
--- Comment #16 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c17
--- Comment #17 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c18
--- Comment #18 from Michal Marek
I can't reproduce any problems. It works fine here with Milestone 5:
# cat /etc/SuSE-release openSUSE 12.1 Milestone 5 (x86_64) VERSION = 12.1 CODENAME = Asparagus
# rpm -q syslog-service syslog-ng systemd syslog-service-1.4.1-748.1.noarch syslog-ng-3.3.0beta2-3.1.x86_64 systemd-33-18.1.x86_64
# grep SYSLOG_DAEMON /etc/sysconfig/syslog SYSLOG_DAEMON="syslog-ng"
Ah, I have # grep SYSLOG_DAEMON /etc/sysconfig/syslog SYSLOG_DAEMON="" But according to the description above, this is valid and means autodetect. I'll try changing it to SYSLOG_DAEMON="syslog-ng" and rebooting. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c19
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c20
--- Comment #20 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c21
--- Comment #21 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c22
--- Comment #22 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c28
Marius Tomaschewski
systemctl status syslog.service syslog.service - System Logging Service Loaded: loaded (/lib/systemd/system/syslog.service; enabled) Active: active (running) since Tue, 20 Sep 2011 14:08:31 +0200; 19h ago Process: 2317 ExecReload=/sbin/killproc -p /var/run/syslog-ng.pid -HUP /sbin/syslog-ng (code=exited, status=0/SUCCESS) Process: 740 ExecStart=/sbin/syslog-ng (code=exited, status=0/SUCCESS) Process: 738 ExecStartPre=/var/run/syslog-ng/addsockets (code=exited, status=0/SUCCESS) Process: 735 ExecStartPre=/bin/systemctl stop systemd-kmsg-syslogd.service (code=exited, status=0/SUCCESS) Main PID: 763 (syslog-ng) CGroup: name=systemd:/system/syslog.service ├ 762 supervising syslog-ng └ 763 /sbin/syslog-ng
lsof | grep /dev/log systemd 1 root 25u unix 0xffff8802211690c0 0t0 4225 /dev/log syslog-ng 762 root 3u unix 0xffff8802211690c0 0t0 4225 /dev/log syslog-ng 763 root 3u unix 0xffff8802211690c0 0t0 4225 /dev/log
ps ax | grep syslog 762 ? S 0:00 supervising syslog-ng 763 ? Ss 0:00 /sbin/syslog-ng
ls -l /proc/763/fd/ total 0 lr-x------ 1 root root 64 Sep 20 14:10 0 -> /dev/null l-wx------ 1 root root 64 Sep 20 14:10 1 -> /dev/null lrwx------ 1 root root 64 Sep 20 14:10 10 -> anon_inode:[eventfd] lrwx------ 1 root root 64 Sep 20 14:10 11 -> anon_inode:[eventfd] lrwx------ 1 root root 64 Sep 20 14:10 12 -> anon_inode:[eventfd] lrwx------ 1 root root 64 Sep 20 14:10 13 -> anon_inode:[eventfd] lrwx------ 1 root root 64 Sep 20 14:10 19 -> /dev/xconsole l-wx------ 1 root root 64 Sep 20 14:10 2 -> /dev/null lrwx------ 1 root root 64 Sep 20 14:10 3 -> socket:[4225] lrwx------ 1 root root 64 Sep 20 14:10 4 -> anon_inode:[eventpoll] l-wx------ 1 root root 64 Sep 20 14:10 5 -> pipe:[8583] lrwx------ 1 root root 64 Sep 20 14:10 6 -> socket:[8602] lrwx------ 1 root root 64 Sep 20 14:10 7 -> anon_inode:[eventfd] lrwx------ 1 root root 64 Sep 20 14:10 8 -> /var/lib/syslog-ng/syslog-ng.persist lr-x------ 1 root root 64 Sep 20 14:10 9 -> /proc/kmsg
Everything looks fine so far, systemd and syslog-ng are using same socket node 4225 ... but logger is unable to send anything to it and blocks in sendto...:
strace logger =========================================== .. socket(PF_FILE, SOCK_DGRAM|SOCK_CLOEXEC, 0) = 1 connect(1, {sa_family=AF_FILE, path="/dev/log"}, 110) = 0 sendto(1, "<13>Sep 21 09:26:30 logger: ===="..., 71, MSG_NOSIGNAL, NULL, 0 --- blocks ---
Syslog-ng shows no reaction on the data send to the systemd /dev/log socket, just waits in epoll:
strace -f -s128 -p 763 Process 763 attached - interrupt to quit clock_gettime(CLOCK_MONOTONIC_RAW, {69938, 341467128}) = 0 epoll_wait(4, {}, 9, 21975) = 0 clock_gettime(CLOCK_MONOTONIC_RAW, {69960, 335242759}) = 0 epoll_wait(4, ^C
and logs its statistics and -- MARK -- messages from time to time to /var/log/messages. After a "systemctl restart syslog.service", it starts reading messages from /dev/log again -- still the using the same socket node 4225 from systemd. It looks like the /dev/log socket would be disabled / removed from the epoll sets after some time (hours)... -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c29
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c30
peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c31
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c32
--- Comment #32 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c33
--- Comment #33 from Marius Tomaschewski
lsof | grep xconsole syslog-ng 6789 root 20u FIFO 0,5 0t0 3586 /dev/xconsole
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c34
--- Comment #34 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c35
--- Comment #35 from Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c36
--- Comment #36 from peter czanik
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c37
--- Comment #37 from Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c38
Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c39
Marius Tomaschewski
https://bugzilla.novell.com/show_bug.cgi?id=719102
https://bugzilla.novell.com/show_bug.cgi?id=719102#c40
--- Comment #40 from Bernhard Wiedemann
participants (1)
-
bugzilla_noreply@novell.com