Hi, I'm seeing multipath issues (failed path) on two servers, anybody have experience with multipathd and stock qlogic and emulex drivers?, this seems like a timeout issue because the path comes up right after going down... ----- extracted from messages ----- Aug 19 09:59:49 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 09:59:49 xen2 kernel: end_request: I/O error, dev sdr, sector 144103576 Aug 19 09:59:49 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 09:59:50 xen2 multipathd: 8:192: reinstated Aug 19 09:59:50 xen2 multipathd: 65:16: mark as failed Aug 19 09:59:50 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 09:59:50 xen2 kernel: end_request: I/O error, dev sdm, sector 144192520 Aug 19 09:59:50 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 09:59:51 xen2 multipathd: 8:192: mark as failed Aug 19 09:59:55 xen2 multipathd: 65:16: reinstated Aug 19 09:59:55 xen2 multipathd: 8:192: reinstated Aug 19 09:59:55 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 09:59:55 xen2 kernel: end_request: I/O error, dev sdm, sector 123330328 Aug 19 09:59:55 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 09:59:56 xen2 multipathd: 8:192: mark as failed Aug 19 09:59:58 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 09:59:58 xen2 kernel: end_request: I/O error, dev sdr, sector 123381800 Aug 19 09:59:58 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 09:59:58 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 09:59:58 xen2 kernel: end_request: I/O error, dev sdr, sector 123382824 Aug 19 09:59:58 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:00 xen2 multipathd: 65:16: reinstated Aug 19 10:00:00 xen2 multipathd: 8:192: reinstated Aug 19 10:00:00 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:00 xen2 kernel: end_request: I/O error, dev sdm, sector 123493496 Aug 19 10:00:00 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:01 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:01 xen2 kernel: end_request: I/O error, dev sdr, sector 123518656 Aug 19 10:00:01 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:01 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:01 xen2 multipathd: lun-xen-images: remaining active paths: 3 Aug 19 10:00:01 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:05 xen2 multipathd: 65:16: reinstated Aug 19 10:00:05 xen2 multipathd: 8:192: reinstated Aug 19 10:00:08 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:08 xen2 kernel: end_request: I/O error, dev sdr, sector 123603936 Aug 19 10:00:08 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:08 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:10 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:10 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:10 xen2 kernel: end_request: I/O error, dev sdm, sector 123725888 Aug 19 10:00:10 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:10 xen2 multipathd: 65:16: reinstated Aug 19 10:00:10 xen2 multipathd: 8:192: reinstated Aug 19 10:00:12 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:12 xen2 kernel: end_request: I/O error, dev sdm, sector 123754208 Aug 19 10:00:12 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:12 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:12 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:12 xen2 kernel: end_request: I/O error, dev sdr, sector 123760352 Aug 19 10:00:12 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:13 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:15 xen2 multipathd: 65:16: reinstated Aug 19 10:00:15 xen2 multipathd: 8:192: reinstated Aug 19 10:00:17 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:17 xen2 kernel: end_request: I/O error, dev sdr, sector 123997624 Aug 19 10:00:17 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:17 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:17 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:17 xen2 kernel: end_request: I/O error, dev sdm, sector 124007776 Aug 19 10:00:17 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:18 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:20 xen2 multipathd: 65:16: reinstated Aug 19 10:00:20 xen2 multipathd: 8:192: reinstated Aug 19 10:00:37 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:37 xen2 kernel: end_request: I/O error, dev sdr, sector 113902096 Aug 19 10:00:37 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:37 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:37 xen2 kernel: end_request: I/O error, dev sdr, sector 113903120 Aug 19 10:00:37 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:40 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:40 xen2 kernel: end_request: I/O error, dev sdm, sector 114057040 Aug 19 10:00:40 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:40 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:42 xen2 multipathd: 65:16: reinstated Aug 19 10:00:42 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:42 xen2 kernel: end_request: I/O error, dev sdr, sector 133075016 Aug 19 10:00:42 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:42 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:42 xen2 kernel: end_request: I/O error, dev sdr, sector 133076040 Aug 19 10:00:43 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:45 xen2 multipathd: 8:192: reinstated Aug 19 10:00:45 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:45 xen2 kernel: end_request: I/O error, dev sdm, sector 133656336 Aug 19 10:00:45 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:46 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:47 xen2 multipathd: 65:16: reinstated Aug 19 10:00:47 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:47 xen2 kernel: end_request: I/O error, dev sdr, sector 131255400 Aug 19 10:00:47 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:48 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:50 xen2 multipathd: 8:192: reinstated Aug 19 10:00:50 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:50 xen2 kernel: end_request: I/O error, dev sdm, sector 131604704 Aug 19 10:00:50 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:51 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:52 xen2 multipathd: 65:16: reinstated Aug 19 10:00:52 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:52 xen2 kernel: end_request: I/O error, dev sdr, sector 124683592 Aug 19 10:00:52 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:53 xen2 multipathd: 65:16: mark as failed Aug 19 10:00:55 xen2 multipathd: 8:192: reinstated Aug 19 10:00:55 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:00:55 xen2 kernel: end_request: I/O error, dev sdm, sector 124800952 Aug 19 10:00:55 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:00:56 xen2 multipathd: 8:192: mark as failed Aug 19 10:00:57 xen2 multipathd: 65:16: reinstated Aug 19 10:00:57 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:00:57 xen2 kernel: end_request: I/O error, dev sdr, sector 124973760 Aug 19 10:00:57 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:00:58 xen2 multipathd: 65:16: mark as failed Aug 19 10:01:00 xen2 multipathd: 8:192: reinstated Aug 19 10:01:02 xen2 multipathd: 65:16: reinstated Aug 19 10:01:19 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:01:19 xen2 kernel: end_request: I/O error, dev sdm, sector 138220568 Aug 19 10:01:19 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:01:19 xen2 multipathd: 8:192: mark as failed Aug 19 10:01:19 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:01:19 xen2 kernel: end_request: I/O error, dev sdr, sector 138220568 Aug 19 10:01:19 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:01:20 xen2 multipathd: 65:16: mark as failed Aug 19 10:01:24 xen2 multipathd: 8:192: reinstated Aug 19 10:01:24 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:01:24 xen2 kernel: end_request: I/O error, dev sdm, sector 125079008 Aug 19 10:01:24 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:01:25 xen2 multipathd: 65:16: reinstated Aug 19 10:01:25 xen2 multipathd: 8:192: mark as failed Aug 19 10:01:25 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:01:25 xen2 kernel: end_request: I/O error, dev sdr, sector 125116184 Aug 19 10:01:25 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:01:26 xen2 multipathd: 65:16: mark as failed Aug 19 10:01:29 xen2 multipathd: 8:192: reinstated Aug 19 10:01:29 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:01:29 xen2 kernel: end_request: I/O error, dev sdm, sector 125433672 Aug 19 10:01:29 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:01:30 xen2 multipathd: 65:16: reinstated Aug 19 10:01:30 xen2 multipathd: 8:192: mark as failed Aug 19 10:01:30 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:01:30 xen2 kernel: end_request: I/O error, dev sdr, sector 125504024 Aug 19 10:01:30 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:01:31 xen2 multipathd: 65:16: mark as failed Aug 19 10:01:34 xen2 multipathd: 8:192: reinstated Aug 19 10:01:35 xen2 multipathd: 65:16: reinstated Aug 19 10:01:35 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 10:01:35 xen2 kernel: end_request: I/O error, dev sdr, sector 126113896 Aug 19 10:01:35 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 10:01:36 xen2 multipathd: 65:16: mark as failed Aug 19 10:01:40 xen2 multipathd: 65:16: reinstated Aug 19 10:01:54 xen2 sshd[5367]: Accepted keyboard-interactive/pam for ferreiri from 10.129.5.220 port 3852 ssh2 Aug 19 10:01:56 xen2 sudo: ferreiri : TTY=pts/5 ; PWD=/ ; USER=root ; COMMAND=/bin/su - Aug 19 10:01:56 xen2 su: (to root) ferreiri on /dev/pts/5 Aug 19 10:09:59 xen2 shadow[7546]: account added to group - account=iriartec, group=root, gid=0, by=0 Aug 19 10:12:46 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 10:12:46 xen2 kernel: end_request: I/O error, dev sdm, sector 88892176 Aug 19 10:12:46 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 10:12:46 xen2 multipathd: 8:192: mark as failed Aug 19 10:12:50 xen2 multipathd: 8:192: reinstated Aug 19 10:15:02 xen2 syslog-ng[5492]: STATS: dropped 0 Aug 19 11:15:02 xen2 syslog-ng[5492]: STATS: dropped 0 Aug 19 11:25:24 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:25:24 xen2 kernel: end_request: I/O error, dev sdr, sector 85279384 Aug 19 11:25:24 xen2 multipathd: 65:16: mark as failed Aug 19 11:25:24 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:25:24 xen2 multipathd: 65:16: reinstated Aug 19 11:26:44 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:26:44 xen2 kernel: end_request: I/O error, dev sdm, sector 128571664 Aug 19 11:26:44 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:26:44 xen2 multipathd: 8:192: mark as failed Aug 19 11:26:44 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:26:44 xen2 kernel: end_request: I/O error, dev sdr, sector 128578832 Aug 19 11:26:44 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:26:45 xen2 multipathd: 65:16: mark as failed Aug 19 11:26:48 xen2 multipathd: 8:192: reinstated Aug 19 11:26:49 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:26:49 xen2 kernel: end_request: I/O error, dev sdm, sector 133384184 Aug 19 11:26:49 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:26:49 xen2 multipathd: 65:16: reinstated Aug 19 11:26:49 xen2 multipathd: 8:192: mark as failed Aug 19 11:26:50 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:26:50 xen2 kernel: end_request: I/O error, dev sdr, sector 136818760 Aug 19 11:26:50 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:26:50 xen2 multipathd: 65:16: mark as failed Aug 19 11:26:53 xen2 multipathd: 8:192: reinstated Aug 19 11:26:54 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:26:54 xen2 kernel: end_request: I/O error, dev sdm, sector 136772720 Aug 19 11:26:54 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:26:54 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:26:54 xen2 kernel: end_request: I/O error, dev sdm, sector 136773744 Aug 19 11:26:54 xen2 multipathd: 65:16: reinstated Aug 19 11:26:54 xen2 multipathd: 8:192: mark as failed Aug 19 11:26:58 xen2 multipathd: 8:192: reinstated Aug 19 11:27:49 xen2 syslog-ng[5492]: SIGHUP received, restarting syslog-ng Aug 19 11:27:50 xen2 syslog-ng[5492]: new configuration initialized Aug 19 11:29:19 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:29:19 xen2 syslog-ng[5492]: Changing permissions on special file /dev/xconsole Aug 19 11:29:19 xen2 syslog-ng[5492]: Changing permissions on special file /dev/tty10 Aug 19 11:29:19 xen2 kernel: end_request: I/O error, dev sdm, sector 85212720 Aug 19 11:29:19 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:29:19 xen2 kernel: klogd 1.4.1, ---------- state change ---------- Aug 19 11:29:19 xen2 multipathd: 8:192: mark as failed Aug 19 11:29:23 xen2 multipathd: 8:192: reinstated Aug 19 11:29:25 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:29:25 xen2 kernel: end_request: I/O error, dev sdm, sector 89134200 Aug 19 11:29:25 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:29:25 xen2 multipathd: 8:192: mark as failed Aug 19 11:29:25 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:29:25 xen2 kernel: end_request: I/O error, dev sdr, sector 89142280 Aug 19 11:29:25 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:29:26 xen2 multipathd: 65:16: mark as failed Aug 19 11:29:28 xen2 multipathd: 8:192: reinstated Aug 19 11:29:29 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:29:29 xen2 kernel: end_request: I/O error, dev sdm, sector 89216720 Aug 19 11:29:29 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:29:29 xen2 multipathd: 8:192: mark as failed Aug 19 11:29:30 xen2 multipathd: 65:16: reinstated Aug 19 11:29:33 xen2 multipathd: 8:192: reinstated Aug 19 11:29:34 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:29:34 xen2 kernel: end_request: I/O error, dev sdm, sector 91475464 Aug 19 11:29:34 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:29:34 xen2 multipathd: 8:192: mark as failed Aug 19 11:29:34 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:29:34 xen2 kernel: end_request: I/O error, dev sdr, sector 89250824 Aug 19 11:29:34 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:29:35 xen2 multipathd: 65:16: mark as failed Aug 19 11:29:38 xen2 multipathd: 8:192: reinstated Aug 19 11:29:40 xen2 multipathd: 65:16: reinstated Aug 19 11:29:41 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:29:41 xen2 kernel: end_request: I/O error, dev sdr, sector 86684616 Aug 19 11:29:41 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:29:41 xen2 multipathd: 65:16: mark as failed Aug 19 11:29:43 xen2 kernel: sd 7:0:0:1: SCSI error: return code = 0x00020000 Aug 19 11:29:43 xen2 kernel: end_request: I/O error, dev sdm, sector 86707168 Aug 19 11:29:43 xen2 kernel: device-mapper: multipath: Failing path 8:192. Aug 19 11:29:43 xen2 multipathd: 8:192: mark as failed Aug 19 11:29:43 xen2 multipathd: 8:192: reinstated Aug 19 11:29:45 xen2 multipathd: 65:16: reinstated Aug 19 11:30:16 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 11:30:16 xen2 kernel: end_request: I/O error, dev sdr, sector 85484824 Aug 19 11:30:16 xen2 multipathd: 65:16: mark as failed Aug 19 11:30:16 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 11:30:21 xen2 multipathd: 65:16: reinstated Aug 19 11:46:30 xen2 sshd[30147]: Accepted publickey for root from 10.129.5.214 port 3952 ssh2 Aug 19 12:00:38 xen2 kernel: sd 7:0:1:1: SCSI error: return code = 0x00020000 Aug 19 12:00:38 xen2 kernel: end_request: I/O error, dev sdr, sector 83669456 Aug 19 12:00:38 xen2 kernel: device-mapper: multipath: Failing path 65:16. Aug 19 12:00:38 xen2 multipathd: 65:16: mark as failed Aug 19 12:00:42 xen2 multipathd: 65:16: reinstated -------------------------- Regards, Ciro -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org