[Bug 233098] New: kernel or amanda regression: wrong source IP addr (was OK in SL 10.0)
https://bugzilla.novell.com/show_bug.cgi?id=233098 Summary: kernel or amanda regression: wrong source IP addr (was OK in SL 10.0) Product: openSUSE 10.2 Version: Final Platform: Other OS/Version: Other Status: NEW Severity: Normal Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: matthias.andree@gmx.de QAContact: qa@suse.de Greetings, I have an amanda setup which worked properly in SUSE Linux 10.0, but fails in openSUSE 10.2 now. It is apparently a regression WRT handling multi-homed amanda server hosts. Observed behavior below. Pertinent packages: amanda-2.5.1.1-17 kernel-default-2.6.18.2-34 Network setup: lo 127.0.0.1 eth0 192.168.1.1 eth1 192.168.0.1 <- main IP address of computer (behind a router) 192.168.0.1 also is the interface to the router, i. e. the interface to carry the default route. With SL 10.0, amanda would work properly. With OS 10.2, amanda (amcheck) logged timeouts waiting for ACK. Amanda is configured to backup 192.168.0.1, 192.168.1.2 and 192.168.0.3. With OS 10.2, I observe that even the packets sent to 192.168. tcpdumping, I found out that amanda would send packets _from_ 192.168.1.1 (rather than the expected 192.168.0.1 as would have been correct for the given path) to 192.168.0.1 and 192.168.0.3, when instead the source address should have been 192.168.0.1. I have worked around this by setting eth0's primary address to 192.168.0.1 and adding an alias of 192.168.1.1 as eth0:1, but that's just some odd and fragile hack that trades less important services, and not a solution. To me, this looks like a new kernel networking bug at first glance, since stracing amcheck, I haven't found any bind() calls to other addresses than 0.0.0.0, and the kernel is supposed to take care that it picks the right source IP for outgoing UDP traffic. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 matthias.andree@gmx.de changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Normal |Critical OS/Version|Other |SuSE Other Platform|Other |i686 ------- Comment #1 from matthias.andree@gmx.de 2007-01-11 10:38 MST ------- Promoting to Critical. 1. The workaround also breaks CUPS browsing and has had to be reverted. 2. My statement on bind() in the original description is bogus since amcheck is setuid root and cannot be straced in a meaningful way. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #2 from matthias.andree@gmx.de 2007-01-11 11:23 MST ------- I've written a wrapper to emulate setuid in an strace compatible way, so that I could run "strace amcheck FullBacks -c". I can confirm that amanda binds its interface to 0.0.0.0 and then sends out its UDP datagrams to the clients. tshark or tcpdump reveal that the source address is wrong, it is sending from 192.168.1.1 to 192.168.0.1. It should instead send from 192.168.0.1. End of the story is that amanda never sees the ACK packets come back. :-( In this trace (tshark and amcheck config -c intermixed), merlin = 192.168.0.1 and 192.168.1.1 is merlin's other IP, as written in the Description above). There shouldn't be any 192.168.1.X address in this conversation. Looks pretty much like the kernel tripping over its own feet. Picks the wrong address, then employs reverse path filtering -- or something like that, I haven't checked ont he networking code. Amanda Backup Client Hosts Check -------------------------------- 29.111602 192.168.1.1 -> 192.168.0.1 UDP Source port: 659 Destination port: 10080 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 97 00 00 40 00 40 11 b8 03 c0 a8 01 01 c0 a8 ....@.@......... 0020 00 01 02 93 27 60 00 83 c3 8e 41 6d 61 6e 64 61 ....'`....Amanda 0030 20 32 2e 35 20 52 45 51 20 48 41 4e 44 4c 45 20 2.5 REQ HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 53 45 43 55 1168254161.SECU 0060 52 49 54 59 20 55 53 45 52 20 61 6d 61 6e 64 61 RITY USER amanda 0070 0a 53 45 52 56 49 43 45 20 6e 6f 6f 70 0a 4f 50 .SERVICE noop.OP 0080 54 49 4f 4e 53 20 66 65 61 74 75 72 65 73 3d 66 TIONS features=f 0090 66 66 66 66 65 66 66 39 66 66 65 66 66 66 66 66 ffffeff9ffefffff 00a0 66 37 66 3b 0a f7f;. 29.112203 192.168.1.1 -> 192.168.1.1 UDP Source port: 10080 Destination port: 659 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 4e 00 00 40 00 40 11 b7 4c c0 a8 01 01 c0 a8 .N..@.@..L...... 0020 01 01 27 60 02 93 00 3a 06 30 41 6d 61 6e 64 61 ..'`...:.0Amanda 0030 20 32 2e 35 20 41 43 4b 20 48 41 4e 44 4c 45 20 2.5 ACK HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 1168254161. 30.110303 192.168.1.1 -> 192.168.1.1 UDP Source port: 10080 Destination port: 585 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 75 00 00 40 00 40 11 b7 25 c0 a8 01 01 c0 a8 .u..@.@..%...... 0020 01 01 27 60 02 49 00 61 cd 6f 41 6d 61 6e 64 61 ..'`.I.a.oAmanda 0030 20 32 2e 35 20 52 45 50 20 48 41 4e 44 4c 45 20 2.5 REP HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 34 33 30 38 37 35 0a 4f 50 54 49 1168430875.OPTI 0060 4f 4e 53 20 66 65 61 74 75 72 65 73 3d 66 66 66 ONS features=fff 0070 66 66 65 66 66 39 66 66 65 66 66 66 66 66 66 37 ffeff9ffeffffff7 0080 66 3b 0a f;. 39.158381 192.168.1.1 -> 192.168.0.1 UDP Source port: 659 Destination port: 10080 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 97 00 00 40 00 40 11 b8 03 c0 a8 01 01 c0 a8 ....@.@......... 0020 00 01 02 93 27 60 00 83 c3 8e 41 6d 61 6e 64 61 ....'`....Amanda 0030 20 32 2e 35 20 52 45 51 20 48 41 4e 44 4c 45 20 2.5 REQ HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 53 45 43 55 1168254161.SECU 0060 52 49 54 59 20 55 53 45 52 20 61 6d 61 6e 64 61 RITY USER amanda 0070 0a 53 45 52 56 49 43 45 20 6e 6f 6f 70 0a 4f 50 .SERVICE noop.OP 0080 54 49 4f 4e 53 20 66 65 61 74 75 72 65 73 3d 66 TIONS features=f 0090 66 66 66 66 65 66 66 39 66 66 65 66 66 66 66 66 ffffeff9ffefffff 00a0 66 37 66 3b 0a f7f;. 39.158999 192.168.1.1 -> 192.168.1.1 UDP Source port: 10080 Destination port: 659 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 4e 00 00 40 00 40 11 b7 4c c0 a8 01 01 c0 a8 .N..@.@..L...... 0020 01 01 27 60 02 93 00 3a 06 30 41 6d 61 6e 64 61 ..'`...:.0Amanda 0030 20 32 2e 35 20 41 43 4b 20 48 41 4e 44 4c 45 20 2.5 ACK HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 1168254161. 40.158350 192.168.1.1 -> 192.168.1.1 UDP Source port: 10080 Destination port: 585 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 75 00 00 40 00 40 11 b7 25 c0 a8 01 01 c0 a8 .u..@.@..%...... 0020 01 01 27 60 02 49 00 61 cd 6f 41 6d 61 6e 64 61 ..'`.I.a.oAmanda 0030 20 32 2e 35 20 52 45 50 20 48 41 4e 44 4c 45 20 2.5 REP HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 34 33 30 38 37 35 0a 4f 50 54 49 1168430875.OPTI 0060 4f 4e 53 20 66 65 61 74 75 72 65 73 3d 66 66 66 ONS features=fff 0070 66 66 65 66 66 39 66 66 65 66 66 66 66 66 66 37 ffeff9ffeffffff7 0080 66 3b 0a f;. 49.158383 192.168.1.1 -> 192.168.0.1 UDP Source port: 659 Destination port: 10080 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 97 00 00 40 00 40 11 b8 03 c0 a8 01 01 c0 a8 ....@.@......... 0020 00 01 02 93 27 60 00 83 c3 8e 41 6d 61 6e 64 61 ....'`....Amanda 0030 20 32 2e 35 20 52 45 51 20 48 41 4e 44 4c 45 20 2.5 REQ HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 53 45 43 55 1168254161.SECU 0060 52 49 54 59 20 55 53 45 52 20 61 6d 61 6e 64 61 RITY USER amanda 0070 0a 53 45 52 56 49 43 45 20 6e 6f 6f 70 0a 4f 50 .SERVICE noop.OP 0080 54 49 4f 4e 53 20 66 65 61 74 75 72 65 73 3d 66 TIONS features=f 0090 66 66 66 66 65 66 66 39 66 66 65 66 66 66 66 66 ffffeff9ffefffff 00a0 66 37 66 3b 0a f7f;. 49.158989 192.168.1.1 -> 192.168.1.1 UDP Source port: 10080 Destination port: 659 0000 00 00 00 00 00 00 00 00 00 00 00 00 08 00 45 00 ..............E. 0010 00 4e 00 00 40 00 40 11 b7 4c c0 a8 01 01 c0 a8 .N..@.@..L...... 0020 01 01 27 60 02 93 00 3a 06 30 41 6d 61 6e 64 61 ..'`...:.0Amanda 0030 20 32 2e 35 20 41 43 4b 20 48 41 4e 44 4c 45 20 2.5 ACK HANDLE 0040 30 30 30 2d 30 30 30 30 30 30 30 30 20 53 45 51 000-00000000 SEQ 0050 20 31 31 36 38 32 35 34 31 36 31 0a 1168254161. WARNING: merlin: selfcheck request failed: timeout waiting for ACK Client check: 3 hosts checked in 30.097 seconds, 2 problems found -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 gregkh@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|kernel- |bnc-team-screening@forge.provo.novell.com |maintainers@forge.provo.nove| |ll.com | Component|Kernel |Basesystem ------- Comment #3 from gregkh@novell.com 2007-01-11 18:21 MST ------- I don't see how this is a kernel issue, reassigning... -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 mhorvath@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- AssignedTo|bnc-team- |lmichnovic@novell.com |screening@forge.provo.novell| |.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 lmichnovic@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |ASSIGNED ------- Comment #4 from lmichnovic@novell.com 2007-01-15 02:37 MST ------- Working. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #5 from matthias.andree@gmx.de 2007-01-15 03:05 MST ------- Two comments to help debugging, which I found out over the week-end: 1. amanda-users post, archived at http://www.mail-archive.com/amanda-users@amanda.org/msg36873.html Essentially, it states that multi-homed clients need to be specified in the disklist either with their primary IP address or with a hostname that resolves to the primary IP address. 2. I've had physical access to my machine, and swapped eth0 and eth1 cables and the corresponding configuration; now Amanda works for me. I understand that not all sites have this option though (think of MAC filtering lists for WLAN; for instance). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 lmichnovic@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Severity|Critical |Normal ------- Comment #6 from lmichnovic@novell.com 2007-05-11 04:27 MST ------- This won't be fixed in 10.2. You can check the new version of amanda in openSUSE 10.3. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #7 from matthias.andree@gmx.de 2007-05-11 05:37 MST ------- I don't think I'll be doing that, but rather switch to Ubuntu - much fewer unfixed regressions there. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #8 from lmichnovic@novell.com 2007-05-11 05:42 MST ------- (In reply to comment #7)
I don't think I'll be doing that, but rather switch to Ubuntu - much fewer unfixed regressions there.
Do you mean regressions regarded to amanda? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #9 from matthias.andree@gmx.de 2007-05-11 06:00 MST ------- Yes. There's more, but I don't think I'll bother reporting them, it's pointless anyways if the policy is freeze whatever you get from upstream when time's due and regression fixes aren't desired. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #10 from lmichnovic@novell.com 2007-05-11 06:42 MST ------- If I understand it correctly, the same version of amanda in Ubuntu doesn't have regressions which are in openSUSE 10.2. Am I right? There is always option to provide fixed package for older distributions via openSUSE Build Service. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #11 from lmichnovic@novell.com 2007-05-11 08:41 MST ------- If you still have SuSE on your computer you could try the latest amanda packages which are available at http://software.opensuse.org/download/home:/lmich/ . -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #12 from matthias.andree@gmx.de 2007-05-11 09:18 MST ------- I still have it on the amanda server and will test. I have now installed amanda-2.5.1.9.1-3.1 and it fixed amoverview regressions I hadn't yet reported. Notably, with the original SUSE 10.2 amanda package, amoverview is defective in that prints excess quote marks and line breaks (perhaps debug or verbose mode stuff) before the table, but then leaves the pretty table (partition vs. date) empty. With the package mentioned above, amoverview works again. I haven't yet checked the interface issue though, will report on that later (next scheduled backup tomorrow). --------------------------------------------------------------------- #! /bin/sh # amanda-report.sh # (C) 2003 by Matthias Andree, GNU GPL v2 PATH=$PATH:/usr/sbin config=${1:-FullBacks} echo "*** Table of Contents ***" echo logdir=`amgetconf $config logdir` \ && log=`ls -1t "$logdir"/log.*.[0-9] | head -1` \ && amtoc -t "$log" echo echo echo "*** Overview ***" echo amoverview $config echo echo echo "*** Tape contents ***" #echo amadmin $config find echo echo echo "*** Next Full dumps due when? ***" echo amadmin $config due echo echo echo "*** Backup balance ***" #echo amadmin $config balance echo echo -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #13 from lmichnovic@novell.com 2007-05-17 09:30 MST ------- I have packed amanda 2.5.2 final version. It has some other little bug fixes against the last package which was beta version of it. The packages are available in the same repository as mentioned in two comments above. You can use it. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #14 from matthias.andree@gmx.de 2007-05-24 07:25 MST ------- I'll test it, expect feedback next week. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #15 from lmichnovic@novell.com 2007-05-25 02:35 MST ------- O.K. Thank you. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #16 from matthias.andree@gmx.de 2007-05-30 08:14 MST ------- Works with amanda on the primary network interface (eth0), haven't yet found the time to check on the secondary (eth1) - I hope to be able to do that on Saturday. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #17 from lmichnovic@novell.com 2007-05-30 08:32 MST ------- O.K. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098 ------- Comment #18 from lmichnovic@novell.com 2007-06-08 09:06 MST ------- Amanda released new bugfix version 2.5.2p1 * Many IPv6 bugs fixed: + missing sockaddr_storage + missing AI_V4MAPPED and AI_ALL + compare of IPv4 and IPv6 v4mapped address. + (bsd/bsdudp): server use two sockets, one for IPv4 and one for IPv6 * amflush/autoflush * chown/chmod * amstatus * compilation on some platform You can find RPMs in my repo as mentioned in comment #11. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098
------- Comment #19 from matthias.andree@gmx.de 2007-06-09 03:14 MST -------
amanda-2.5.2.1-1.1 causes new regressions.
Network configuration (abridged):
2: eth0:
https://bugzilla.novell.com/show_bug.cgi?id=233098 lmichnovic@novell.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|ASSIGNED |NEEDINFO Info Provider| |matthias.andree@gmx.de ------- Comment #20 from lmichnovic@novell.com 2007-06-11 07:20 MST ------- Could you please attach debug files: sendsize.*.debug and amanda.*.debug form the client and planner.*.debug from the server from the 2.5.1.p1 version? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug, or are watching someone who is.
https://bugzilla.novell.com/show_bug.cgi?id=233098#c21
Ladislav Michnovič
participants (1)
-
bugzilla_noreply＠novell.com