[Bug 358865] New: memory corruption in Xvnc, prevents vnc installation
https://bugzilla.novell.com/show_bug.cgi?id=358865 Summary: memory corruption in Xvnc, prevents vnc installation Product: openSUSE 11.0 Version: Alpha 1 Platform: PowerPC OS/Version: Linux Status: NEW Severity: Normal Priority: P5 - None Component: X.Org AssignedTo: sndirsch@novell.com ReportedBy: olh@novell.com QAContact: xorg-maintainer-bugs@forge.provo.novell.com CC: power-bugs@forge.provo.novell.com Found By: --- 11.0a1 and also current factory fails with vnc install. As soon as one connects to the server, the Xvnc process gets terminated by glibc malloc checker. sometimes Xvnc gets aborted right away after connect. sometimes a corrupted screen is displayed, then Xvnc is terminated. A quick test on i386 factory shows that vnc seems to work there. I dont have a better backtrace at the moment, due to lack of related -debuginfo.rpm in the inst-sys. Program received signal SIGABRT, Aborted. [Switching to Thread 0xf7ff4000 (LWP 2702)] 0x0f85dddc in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); (gdb) bt #0 0x0f85dddc in *__GI_raise (sig=6) at ./nptl/sysdeps/unix/sysv/linux/raise.c:64 #1 0x0f85f7d8 in *__GI_abort () at abort.c:88 #2 0x0f89c098 in __libc_message (do_abort=2, fmt=0xf965880 "*** glibc detected *** %s: %s: 0x%s ***\n") at ../sysdeps/unix/sysv/linux/libc_fatal.c:170 #3 0x0f8a33c0 in malloc_printerr (action=3, str=0xf965a54 "double free or corruption (!prev)", ptr=<value optimized out>) at malloc.c:5891 #4 0x0f8a5878 in *__GI___libc_free (mem=0x1059f430) at malloc.c:3626 #5 0x1005db48 in rfbTranslateNone () #6 0x10057c78 in ?? () #7 0x10059610 in ?? () #8 0x10059c68 in rfbSendRectEncodingTight () #9 0x10059d10 in rfbSendRectEncodingTight () #10 0x1004adc8 in rfbSendFramebufferUpdate () #11 0x1004cbd8 in rfbProcessClientMessage () #12 0x1005557c in rfbCheckFds () #13 0x1004761c in ?? () #14 0x100777c8 in WakeupHandler () #15 0x103a1434 in WaitForSomething () #16 0x100729f8 in Dispatch () #17 0x1008a784 in main () (gdb) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c1
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c2
--- Comment #2 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c3
--- Comment #3 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c4
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c5
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c6
--- Comment #6 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c7
--- Comment #7 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c8
--- Comment #8 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c9
--- Comment #9 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User eich@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c10
Egbert Eich
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c11
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c12
--- Comment #12 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c14
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c15
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c16
Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=358865
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c17
--- Comment #17 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c18
--- Comment #18 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c19
--- Comment #19 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c20
--- Comment #20 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c21
--- Comment #21 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c22
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c23
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c24
Stefan Dirsch
it happens also in the running system.
gdb --quiet --readnow --ex 'b main' -ex 'r -noreset -inetd -once -query localhost -geometry 1024x768 -depth 16' /usr/bin/Xvnc
# gdb --quiet --readnow --ex 'b main' -ex 'r -noreset -inetd -once -query localhost -geometry 1024x768 -depth 16' /usr/bin/Xvnc (no debugging symbols found) Breakpoint 1 at 0x1008a344 Starting program: /usr/bin/Xvnc -noreset -inetd -once -query localhost -geometry 1024x768 -depth 16 [Thread debugging using libthread_db enabled] [New Thread 0xf7fa9000 (LWP 19888)] [Switching to Thread 0xf7fa9000 (LWP 19888)] Breakpoint 1, 0x1008a344 in main () (gdb) And now what? How to connect to this VNC server? Pressing 'c' in gdb afterwards? Tried this instead: # Xvnc r -noreset -once -query localhost -geometry 1024x768 -depth 16 connected via "vncviewer pear". Works fine. I didn't use -inetd. This is the only difference. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c25
--- Comment #25 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c26
--- Comment #26 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c27
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c28
--- Comment #28 from Stefan Dirsch
of course, that should have been something like: Xvnc -noreset -geometry 1024x768 -rfbport 5901 -rfbwait 120000 -depth 16 :42
port 5901 doesn't work. There's another VNC already running. Tried it instead with port 6000: pear:~ # Xvnc -noreset -geometry 1024x768 -rfbport 6000 -rfbwait 120000 \ -depth 16 :42 and connected with shannon(x86_64):~ # vncviewer pear::6000 Still works fine. (In reply to comment #26 from Olaf Hering)
its from bigendian to bigendian. I guess you see no garbage when connecting from little endian to big endian.
No garbage when connecting from x86_64(vncviewer) to ppc64(Xvnc). Maybe you're using a different VNC viewer? On which architecture do you run your VNC viewer? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c29
Stefan Dirsch
a 11.0a1 (and later) vncviewer can connect to any vncserver (from sles10 to 11.0a2) an older vncviewer (from sles10 to 10.3) can not connect to an 11.0a1 (and later) vncserver did the protocol version change after 10.3? Looks like a missing byte swap somewhere On x86_64 the vncviewer of tightvnc of 10.1, 10.2, 10.3 and STABLE works fine. So on which machine do I need to start tightvnc to reproduce this issue?
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c30
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c31
--- Comment #31 from Stefan Dirsch
running vncviewer (logged in via ssh) on mac.suse.de to vncserver on mac.suse.de, I cannot reproduce this corruption.
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c32
--- Comment #32 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c34
--- Comment #34 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c35
--- Comment #35 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User eich@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c36
--- Comment #36 from Egbert Eich
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c37
--- Comment #37 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User eich@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c38
--- Comment #38 from Egbert Eich
4) on weissichgradnich: vncviewer pear::6666 --> works (x86 --> ppc) 5) ssh to pear 6) on pear: vncviewer pear::6666 --> Xvnc crashes (ppc --> ppc)
To me 4 and 6 seem to connect to the same Xvnc server. What seems to happen here, is that the vnc viewer in 4 is running inside the vncviewer started in 1 (on what machine?). Which server crahses by the way, the one on pear or the one on 'weissichgradnich'? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c39
--- Comment #39 from Stefan Dirsch
Stefan,
4) on weissichgradnich: vncviewer pear::6666 --> works (x86 --> ppc) 5) ssh to pear 6) on pear: vncviewer pear::6666 --> Xvnc crashes (ppc --> ppc)
To me 4 and 6 seem to connect to the same Xvnc server.
Yes, but I never tried to run them simultaneously. I only wanted to show, that vncviewer started on weissichgradnich does not crash the Xvnc on pear.
What seems to happen here, is that the vnc viewer in 4 is running inside the vncviewer started in 1 (on what machine?).
Yes, that's correct. The vncviewer started in 1 is running on shannon (x86_64).
Which server crahses by the way, the one on pear or the one on 'weissichgradnich'?
The Xvnc on pear is crashing. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User eich@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c40
--- Comment #40 from Egbert Eich
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c41
--- Comment #41 from Stefan Dirsch
So the crash would also happen without 4)?
Yes.
so 6) has noting to do with the previous steps. 6 alone should make things crash, right? The only condition is that the pear -> pear (BE->BE) vncviwer is viewed itself on an LE machine, right?
On a Xvnc on a LE machine apparently. Otherwise I would have been able to reproduce the crash also by ssh'ing directly from shannon (LE/x86_64) to pear. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c42
--- Comment #42 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c43
--- Comment #43 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c44
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c45
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c46
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c47
--- Comment #47 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c48
--- Comment #48 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c49
--- Comment #49 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c50
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c51
Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User olh@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c52
--- Comment #52 from Olaf Hering
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c53
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c54
--- Comment #54 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c55
--- Comment #55 from Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
User mls@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c56
Michael Schröder
https://bugzilla.novell.com/show_bug.cgi?id=358865
User sndirsch@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=358865#c57
Stefan Dirsch
https://bugzilla.novell.com/show_bug.cgi?id=358865
Olaf Hering
participants (1)
-
bugzilla_noreply@novell.com