Hi,
I'm seeing multipath issues (failed path) on two servers, anybody have
experience with multipathd and stock qlogic and emulex drivers?, this
seems like a timeout issue because the path comes up right after going
down...
----- extracted from messages -----
Aug 19 09:59:49 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 09:59:49 xen2 kernel: end_request: I/O error, dev sdr, sector 144103576
Aug 19 09:59:49 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 09:59:50 xen2 multipathd: 8:192: reinstated
Aug 19 09:59:50 xen2 multipathd: 65:16: mark as failed
Aug 19 09:59:50 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 09:59:50 xen2 kernel: end_request: I/O error, dev sdm, sector 144192520
Aug 19 09:59:50 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 09:59:51 xen2 multipathd: 8:192: mark as failed
Aug 19 09:59:55 xen2 multipathd: 65:16: reinstated
Aug 19 09:59:55 xen2 multipathd: 8:192: reinstated
Aug 19 09:59:55 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 09:59:55 xen2 kernel: end_request: I/O error, dev sdm, sector 123330328
Aug 19 09:59:55 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 09:59:56 xen2 multipathd: 8:192: mark as failed
Aug 19 09:59:58 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 09:59:58 xen2 kernel: end_request: I/O error, dev sdr, sector 123381800
Aug 19 09:59:58 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 09:59:58 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 09:59:58 xen2 kernel: end_request: I/O error, dev sdr, sector 123382824
Aug 19 09:59:58 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:00 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:00 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:00 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:00 xen2 kernel: end_request: I/O error, dev sdm, sector 123493496
Aug 19 10:00:00 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:01 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:01 xen2 kernel: end_request: I/O error, dev sdr, sector 123518656
Aug 19 10:00:01 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:01 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:01 xen2 multipathd: lun-xen-images: remaining active paths: 3
Aug 19 10:00:01 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:05 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:05 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:08 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:08 xen2 kernel: end_request: I/O error, dev sdr, sector 123603936
Aug 19 10:00:08 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:08 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:10 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:10 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:10 xen2 kernel: end_request: I/O error, dev sdm, sector 123725888
Aug 19 10:00:10 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:10 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:10 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:12 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:12 xen2 kernel: end_request: I/O error, dev sdm, sector 123754208
Aug 19 10:00:12 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:12 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:12 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:12 xen2 kernel: end_request: I/O error, dev sdr, sector 123760352
Aug 19 10:00:12 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:13 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:15 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:15 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:17 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:17 xen2 kernel: end_request: I/O error, dev sdr, sector 123997624
Aug 19 10:00:17 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:17 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:17 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:17 xen2 kernel: end_request: I/O error, dev sdm, sector 124007776
Aug 19 10:00:17 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:18 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:20 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:20 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:37 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:37 xen2 kernel: end_request: I/O error, dev sdr, sector 113902096
Aug 19 10:00:37 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:37 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:37 xen2 kernel: end_request: I/O error, dev sdr, sector 113903120
Aug 19 10:00:37 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:40 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:40 xen2 kernel: end_request: I/O error, dev sdm, sector 114057040
Aug 19 10:00:40 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:40 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:42 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:42 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:42 xen2 kernel: end_request: I/O error, dev sdr, sector 133075016
Aug 19 10:00:42 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:42 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:42 xen2 kernel: end_request: I/O error, dev sdr, sector 133076040
Aug 19 10:00:43 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:45 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:45 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:45 xen2 kernel: end_request: I/O error, dev sdm, sector 133656336
Aug 19 10:00:45 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:46 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:47 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:47 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:47 xen2 kernel: end_request: I/O error, dev sdr, sector 131255400
Aug 19 10:00:47 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:48 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:50 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:50 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:50 xen2 kernel: end_request: I/O error, dev sdm, sector 131604704
Aug 19 10:00:50 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:51 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:52 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:52 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:52 xen2 kernel: end_request: I/O error, dev sdr, sector 124683592
Aug 19 10:00:52 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:53 xen2 multipathd: 65:16: mark as failed
Aug 19 10:00:55 xen2 multipathd: 8:192: reinstated
Aug 19 10:00:55 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:00:55 xen2 kernel: end_request: I/O error, dev sdm, sector 124800952
Aug 19 10:00:55 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:00:56 xen2 multipathd: 8:192: mark as failed
Aug 19 10:00:57 xen2 multipathd: 65:16: reinstated
Aug 19 10:00:57 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:00:57 xen2 kernel: end_request: I/O error, dev sdr, sector 124973760
Aug 19 10:00:57 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:00:58 xen2 multipathd: 65:16: mark as failed
Aug 19 10:01:00 xen2 multipathd: 8:192: reinstated
Aug 19 10:01:02 xen2 multipathd: 65:16: reinstated
Aug 19 10:01:19 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:01:19 xen2 kernel: end_request: I/O error, dev sdm, sector 138220568
Aug 19 10:01:19 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:01:19 xen2 multipathd: 8:192: mark as failed
Aug 19 10:01:19 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:01:19 xen2 kernel: end_request: I/O error, dev sdr, sector 138220568
Aug 19 10:01:19 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:01:20 xen2 multipathd: 65:16: mark as failed
Aug 19 10:01:24 xen2 multipathd: 8:192: reinstated
Aug 19 10:01:24 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:01:24 xen2 kernel: end_request: I/O error, dev sdm, sector 125079008
Aug 19 10:01:24 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:01:25 xen2 multipathd: 65:16: reinstated
Aug 19 10:01:25 xen2 multipathd: 8:192: mark as failed
Aug 19 10:01:25 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:01:25 xen2 kernel: end_request: I/O error, dev sdr, sector 125116184
Aug 19 10:01:25 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:01:26 xen2 multipathd: 65:16: mark as failed
Aug 19 10:01:29 xen2 multipathd: 8:192: reinstated
Aug 19 10:01:29 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:01:29 xen2 kernel: end_request: I/O error, dev sdm, sector 125433672
Aug 19 10:01:29 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:01:30 xen2 multipathd: 65:16: reinstated
Aug 19 10:01:30 xen2 multipathd: 8:192: mark as failed
Aug 19 10:01:30 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:01:30 xen2 kernel: end_request: I/O error, dev sdr, sector 125504024
Aug 19 10:01:30 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:01:31 xen2 multipathd: 65:16: mark as failed
Aug 19 10:01:34 xen2 multipathd: 8:192: reinstated
Aug 19 10:01:35 xen2 multipathd: 65:16: reinstated
Aug 19 10:01:35 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 10:01:35 xen2 kernel: end_request: I/O error, dev sdr, sector 126113896
Aug 19 10:01:35 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 10:01:36 xen2 multipathd: 65:16: mark as failed
Aug 19 10:01:40 xen2 multipathd: 65:16: reinstated
Aug 19 10:01:54 xen2 sshd[5367]: Accepted keyboard-interactive/pam for
ferreiri from 10.129.5.220 port 3852 ssh2
Aug 19 10:01:56 xen2 sudo: ferreiri : TTY=pts/5 ; PWD=/ ; USER=root ;
COMMAND=/bin/su -
Aug 19 10:01:56 xen2 su: (to root) ferreiri on /dev/pts/5
Aug 19 10:09:59 xen2 shadow[7546]: account added to group -
account=iriartec, group=root, gid=0, by=0
Aug 19 10:12:46 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 10:12:46 xen2 kernel: end_request: I/O error, dev sdm, sector 88892176
Aug 19 10:12:46 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 10:12:46 xen2 multipathd: 8:192: mark as failed
Aug 19 10:12:50 xen2 multipathd: 8:192: reinstated
Aug 19 10:15:02 xen2 syslog-ng[5492]: STATS: dropped 0
Aug 19 11:15:02 xen2 syslog-ng[5492]: STATS: dropped 0
Aug 19 11:25:24 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:25:24 xen2 kernel: end_request: I/O error, dev sdr, sector 85279384
Aug 19 11:25:24 xen2 multipathd: 65:16: mark as failed
Aug 19 11:25:24 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:25:24 xen2 multipathd: 65:16: reinstated
Aug 19 11:26:44 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:26:44 xen2 kernel: end_request: I/O error, dev sdm, sector 128571664
Aug 19 11:26:44 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:26:44 xen2 multipathd: 8:192: mark as failed
Aug 19 11:26:44 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:26:44 xen2 kernel: end_request: I/O error, dev sdr, sector 128578832
Aug 19 11:26:44 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:26:45 xen2 multipathd: 65:16: mark as failed
Aug 19 11:26:48 xen2 multipathd: 8:192: reinstated
Aug 19 11:26:49 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:26:49 xen2 kernel: end_request: I/O error, dev sdm, sector 133384184
Aug 19 11:26:49 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:26:49 xen2 multipathd: 65:16: reinstated
Aug 19 11:26:49 xen2 multipathd: 8:192: mark as failed
Aug 19 11:26:50 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:26:50 xen2 kernel: end_request: I/O error, dev sdr, sector 136818760
Aug 19 11:26:50 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:26:50 xen2 multipathd: 65:16: mark as failed
Aug 19 11:26:53 xen2 multipathd: 8:192: reinstated
Aug 19 11:26:54 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:26:54 xen2 kernel: end_request: I/O error, dev sdm, sector 136772720
Aug 19 11:26:54 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:26:54 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:26:54 xen2 kernel: end_request: I/O error, dev sdm, sector 136773744
Aug 19 11:26:54 xen2 multipathd: 65:16: reinstated
Aug 19 11:26:54 xen2 multipathd: 8:192: mark as failed
Aug 19 11:26:58 xen2 multipathd: 8:192: reinstated
Aug 19 11:27:49 xen2 syslog-ng[5492]: SIGHUP received, restarting syslog-ng
Aug 19 11:27:50 xen2 syslog-ng[5492]: new configuration initialized
Aug 19 11:29:19 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:29:19 xen2 syslog-ng[5492]: Changing permissions on special
file /dev/xconsole
Aug 19 11:29:19 xen2 syslog-ng[5492]: Changing permissions on special
file /dev/tty10
Aug 19 11:29:19 xen2 kernel: end_request: I/O error, dev sdm, sector 85212720
Aug 19 11:29:19 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:29:19 xen2 kernel: klogd 1.4.1, ---------- state change ----------
Aug 19 11:29:19 xen2 multipathd: 8:192: mark as failed
Aug 19 11:29:23 xen2 multipathd: 8:192: reinstated
Aug 19 11:29:25 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:29:25 xen2 kernel: end_request: I/O error, dev sdm, sector 89134200
Aug 19 11:29:25 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:29:25 xen2 multipathd: 8:192: mark as failed
Aug 19 11:29:25 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:29:25 xen2 kernel: end_request: I/O error, dev sdr, sector 89142280
Aug 19 11:29:25 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:29:26 xen2 multipathd: 65:16: mark as failed
Aug 19 11:29:28 xen2 multipathd: 8:192: reinstated
Aug 19 11:29:29 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:29:29 xen2 kernel: end_request: I/O error, dev sdm, sector 89216720
Aug 19 11:29:29 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:29:29 xen2 multipathd: 8:192: mark as failed
Aug 19 11:29:30 xen2 multipathd: 65:16: reinstated
Aug 19 11:29:33 xen2 multipathd: 8:192: reinstated
Aug 19 11:29:34 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:29:34 xen2 kernel: end_request: I/O error, dev sdm, sector 91475464
Aug 19 11:29:34 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:29:34 xen2 multipathd: 8:192: mark as failed
Aug 19 11:29:34 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:29:34 xen2 kernel: end_request: I/O error, dev sdr, sector 89250824
Aug 19 11:29:34 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:29:35 xen2 multipathd: 65:16: mark as failed
Aug 19 11:29:38 xen2 multipathd: 8:192: reinstated
Aug 19 11:29:40 xen2 multipathd: 65:16: reinstated
Aug 19 11:29:41 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:29:41 xen2 kernel: end_request: I/O error, dev sdr, sector 86684616
Aug 19 11:29:41 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:29:41 xen2 multipathd: 65:16: mark as failed
Aug 19 11:29:43 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000
Aug 19 11:29:43 xen2 kernel: end_request: I/O error, dev sdm, sector 86707168
Aug 19 11:29:43 xen2 kernel: device-mapper: multipath: Failing path 8:192.
Aug 19 11:29:43 xen2 multipathd: 8:192: mark as failed
Aug 19 11:29:43 xen2 multipathd: 8:192: reinstated
Aug 19 11:29:45 xen2 multipathd: 65:16: reinstated
Aug 19 11:30:16 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 11:30:16 xen2 kernel: end_request: I/O error, dev sdr, sector 85484824
Aug 19 11:30:16 xen2 multipathd: 65:16: mark as failed
Aug 19 11:30:16 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 11:30:21 xen2 multipathd: 65:16: reinstated
Aug 19 11:46:30 xen2 sshd[30147]: Accepted publickey for root from
10.129.5.214 port 3952 ssh2
Aug 19 12:00:38 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000
Aug 19 12:00:38 xen2 kernel: end_request: I/O error, dev sdr, sector 83669456
Aug 19 12:00:38 xen2 kernel: device-mapper: multipath: Failing path 65:16.
Aug 19 12:00:38 xen2 multipathd: 65:16: mark as failed
Aug 19 12:00:42 xen2 multipathd: 65:16: reinstated
--------------------------
Regards,
Ciro
--
To unsubscribe, e-mail: opensuse+unsubscribe(a)opensuse.org
For additional commands, e-mail: opensuse+help(a)opensuse.org