Bug ID 1056408
Summary dm-mpath path remove/add events are received out of order
Classification openSUSE
Product openSUSE Tumbleweed
Version Current
Hardware Other
OS Other
Status NEW
Severity Minor
Priority P5 - None
Component Kernel
Assignee kernel-maintainers@forge.provo.novell.com
Reporter martin.wilck@suse.com
QA Contact qa-bugs@suse.de
Found By ---
Blocker --- 

Created attachment 738867 [details]
Full journalctl output of the test run

I'm not sure if this is really a bug. Currently just documenting it here for
further reference.

The following is an excerpt of udev monitor output captured while removing and
re-adding paths to a multipath map. All paths are removed using the "delete"
attribute of the SCSI devices in sysfs until no paths are left, and re-added
using "scan" on the scsi host later. 

It would be expected that NR_VALID_PATHS decreases monotonically to 0 while
this happens, and increases again to the full path count (6).

The logs show that this is not the case:

> [390917.224026] bremer udevadm[27187]: KERNEL - the kernel uevent
> [390917.228859] bremer udevadm[27187]: KERNEL[390917.228488] change   /devices/virtual/block/dm-1 (block)
> [390917.228859] bremer udevadm[27187]: SEQNUM=42117
> [390918.526074] bremer udevadm[27187]: KERNEL[390918.526012] change   /devices/virtual/block/dm-1 (block)
> [390918.526074] bremer udevadm[27187]: SEQNUM=42118
> [390918.659679] bremer udevadm[27187]: KERNEL[390918.659656] add      /devices/virtual/block/dm-20 (block)
> [390918.659679] bremer udevadm[27187]: SEQNUM=42120
> [390918.694564] bremer udevadm[27187]: KERNEL[390918.692580] change   /devices/virtual/block/dm-20 (block)
> [390918.694564] bremer udevadm[27187]: SEQNUM=42121
> [390918.738590] bremer udevadm[27187]: KERNEL[390918.737979] change   /devices/virtual/block/dm-1 (block)
> [390918.738590] bremer udevadm[27187]: SEQNUM=42122
> [390918.786888] bremer udevadm[27187]: KERNEL[390918.786432] change   /devices/virtual/block/dm-20 (block)
> [390918.786888] bremer udevadm[27187]: SEQNUM=42123
> [390921.254530] bremer udevadm[27187]: KERNEL[390921.254492] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390921.254530] bremer udevadm[27187]: SEQNUM=42129
> [390921.283316] bremer udevadm[27187]: KERNEL[390921.279872] change   /devices/virtual/block/dm-1 (block)
> [390921.283316] bremer udevadm[27187]: SEQNUM=42131
> [390921.418111] bremer udevadm[27187]: KERNEL[390921.417388] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390921.418111] bremer udevadm[27187]: SEQNUM=42137
> [390921.456920] bremer udevadm[27187]: KERNEL[390921.456897] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390921.456920] bremer udevadm[27187]: SEQNUM=42144
> [390921.521188] bremer udevadm[27187]: KERNEL[390921.521081] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390921.521188] bremer udevadm[27187]: SEQNUM=42151
> [390921.563882] bremer udevadm[27187]: KERNEL[390921.563442] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390921.563882] bremer udevadm[27187]: SEQNUM=42158
> [390921.598413] bremer udevadm[27187]: KERNEL[390921.598384] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390921.598413] bremer udevadm[27187]: SEQNUM=42165
> [390922.657808] bremer udevadm[27187]: KERNEL[390922.656629] change   /devices/virtual/block/dm-1 (block)
> [390922.657808] bremer udevadm[27187]: SEQNUM=42167
> [390922.663968] bremer udevadm[27187]: KERNEL[390922.663941] change   /devices/virtual/block/dm-1 (block)
> [390922.663968] bremer udevadm[27187]: DM_NR_VALID_PATHS=2
> [390922.663968] bremer udevadm[27187]: SEQNUM=42168
> [390922.669569] bremer udevadm[27187]: KERNEL[390922.664428] change   /devices/virtual/block/dm-1 (block)
> [390922.669569] bremer udevadm[27187]: DM_NR_VALID_PATHS=3
> [390922.669569] bremer udevadm[27187]: SEQNUM=42169
> [390922.681809] bremer udevadm[27187]: KERNEL[390922.681784] change   /devices/virtual/block/dm-1 (block)
> [390922.681809] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390922.681809] bremer udevadm[27187]: SEQNUM=42170
> [390922.685992] bremer udevadm[27187]: KERNEL[390922.681883] change   /devices/virtual/block/dm-1 (block)
> [390922.685992] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390922.685992] bremer udevadm[27187]: SEQNUM=42171
> [390923.007623] bremer udevadm[27187]: KERNEL[390923.005324] change   /devices/virtual/block/dm-1 (block)
> [390923.007623] bremer udevadm[27187]: SEQNUM=42172
> [390923.191107] bremer udevadm[27187]: KERNEL[390923.191008] change   /devices/virtual/block/dm-1 (block)
> [390923.191107] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390923.191107] bremer udevadm[27187]: SEQNUM=42173
> [390923.191107] bremer udevadm[27187]: KERNEL[390923.191107] change   /devices/virtual/block/dm-1 (block)
> [390923.191107] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390923.197820] bremer udevadm[27187]: SEQNUM=42174
> [390923.197820] bremer udevadm[27187]: KERNEL[390923.191188] change   /devices/virtual/block/dm-1 (block)
> [390923.197820] bremer udevadm[27187]: DM_NR_VALID_PATHS=2
> [390923.197820] bremer udevadm[27187]: SEQNUM=42175
> [390923.327083] bremer udevadm[27187]: KERNEL[390923.326048] change   /devices/virtual/block/dm-1 (block)
> [390923.327083] bremer udevadm[27187]: SEQNUM=42176
> [390923.465309] bremer udevadm[27187]: KERNEL[390923.465183] change   /devices/virtual/block/dm-1 (block)
> [390923.465309] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390923.465309] bremer udevadm[27187]: SEQNUM=42177
> [390923.465309] bremer udevadm[27187]: KERNEL[390923.465255] change   /devices/virtual/block/dm-1 (block)
> [390923.465309] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390923.465309] bremer udevadm[27187]: SEQNUM=42178
> [390923.525701] bremer udevadm[27187]: KERNEL[390923.525677] change   /devices/virtual/block/dm-1 (block)
> [390923.525701] bremer udevadm[27187]: SEQNUM=42179
> [390923.530397] bremer udevadm[27187]: KERNEL[390923.527355] change   /devices/virtual/block/dm-1 (block)
> [390923.530397] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390923.530397] bremer udevadm[27187]: SEQNUM=42180
> [390923.728997] bremer udevadm[27187]: KERNEL[390923.728977] change   /devices/virtual/block/dm-1 (block)
> [390923.728997] bremer udevadm[27187]: SEQNUM=42181
> [390924.428687] bremer udevadm[27187]: KERNEL[390924.428662] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390924.428687] bremer udevadm[27187]: SEQNUM=42187
> [390924.432974] bremer udevadm[27187]: KERNEL[390924.428740] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd/sdd1 (block)
> [390924.432974] bremer udevadm[27187]: SEQNUM=42188
> [390924.542892] bremer udevadm[27187]: KERNEL[390924.541111] change   /devices/virtual/block/dm-1 (block)
> [390924.542892] bremer udevadm[27187]: SEQNUM=42189
> [390925.271616] bremer udevadm[27187]: KERNEL[390925.260886] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390925.271616] bremer udevadm[27187]: SEQNUM=42196
> [390925.271616] bremer udevadm[27187]: KERNEL[390925.266471] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf/sdf1 (block)
> [390925.271616] bremer udevadm[27187]: SEQNUM=42197
> [390926.801746] bremer udevadm[27187]: KERNEL[390926.793914] change   /devices/virtual/block/dm-1 (block)
> [390926.801746] bremer udevadm[27187]: SEQNUM=42199
> [390926.986451] bremer udevadm[27187]: KERNEL[390926.985953] change   /devices/virtual/block/dm-20 (block)
> [390926.986451] bremer udevadm[27187]: SEQNUM=42200
> [390927.120020] bremer udevadm[27187]: KERNEL[390927.119970] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390927.120020] bremer udevadm[27187]: SEQNUM=42208
> [390927.123365] bremer udevadm[27187]: KERNEL[390927.120445] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj/sdj1 (block)
> [390927.123365] bremer udevadm[27187]: SEQNUM=42209
> [390927.317358] bremer udevadm[27187]: KERNEL[390927.317323] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390927.317358] bremer udevadm[27187]: SEQNUM=42218
> [390927.326789] bremer udevadm[27187]: KERNEL[390927.326772] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390927.326789] bremer udevadm[27187]: SEQNUM=42219
> [390927.351321] bremer udevadm[27187]: KERNEL[390927.327152] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn/sdn1 (block)
> [390927.351321] bremer udevadm[27187]: SEQNUM=42220
> [390927.351321] bremer udevadm[27187]: KERNEL[390927.351084] change   /devices/virtual/block/dm-1 (block)
> [390927.351321] bremer udevadm[27187]: SEQNUM=42221
> [390927.516235] bremer udevadm[27187]: KERNEL[390927.515269] change   /devices/virtual/block/dm-20 (block)
> [390927.527714] bremer udevadm[27187]: SEQNUM=42222
> [390928.200506] bremer udevadm[27187]: KERNEL[390927.770567] change   /devices/virtual/block/dm-1 (block)
> [390928.200506] bremer udevadm[27187]: SEQNUM=42223
> [390928.200506] bremer udevadm[27187]: KERNEL[390927.943102] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390928.200506] bremer udevadm[27187]: SEQNUM=42226
> [390928.315254] bremer udevadm[27187]: KERNEL[390928.211714] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390928.315254] bremer udevadm[27187]: SEQNUM=42235
> [390928.315254] bremer udevadm[27187]: KERNEL[390928.211751] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390928.315254] bremer udevadm[27187]: SEQNUM=42236
> [390928.315254] bremer udevadm[27187]: KERNEL[390928.211783] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp/sdp1 (block)
> [390928.315254] bremer udevadm[27187]: SEQNUM=42237
> [390928.315254] bremer udevadm[27187]: KERNEL[390928.251606] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390928.315254] bremer udevadm[27187]: SEQNUM=42238
> [390928.315254] bremer udevadm[27187]: KERNEL[390928.282997] change   /devices/virtual/block/dm-1 (block)
> [390928.315254] bremer udevadm[27187]: SEQNUM=42239
> [390928.817829] bremer udevadm[27187]: KERNEL[390928.816822] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390928.817829] bremer udevadm[27187]: SEQNUM=42247
> [390928.854385] bremer udevadm[27187]: KERNEL[390928.820989] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr/sdr1 (block)
> [390928.854385] bremer udevadm[27187]: SEQNUM=42248
> [390929.247051] bremer udevadm[27187]: KERNEL[390929.246512] change   /devices/virtual/block/dm-1 (block)
> [390929.247051] bremer udevadm[27187]: SEQNUM=42249
> [390929.394536] bremer udevadm[27187]: KERNEL[390929.394166] change   /devices/virtual/block/dm-1 (block)
> [390929.394536] bremer udevadm[27187]: SEQNUM=42250
> [390929.611595] bremer udevadm[27187]: KERNEL[390929.611539] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390929.611595] bremer udevadm[27187]: SEQNUM=42252
> [390929.663785] bremer udevadm[27187]: KERNEL[390929.663663] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390929.663785] bremer udevadm[27187]: SEQNUM=42254
> [390929.719168] bremer udevadm[27187]: KERNEL[390929.717500] change   /devices/virtual/block/dm-1 (block)
> [390929.719168] bremer udevadm[27187]: SEQNUM=42255
> [390929.723174] bremer udevadm[27187]: KERNEL[390929.719502] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390929.723174] bremer udevadm[27187]: SEQNUM=42257
> [390929.735876] bremer udevadm[27187]: KERNEL[390929.735848] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390929.735876] bremer udevadm[27187]: SEQNUM=42259
> [390929.755386] bremer udevadm[27187]: KERNEL[390929.755343] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390929.755386] bremer udevadm[27187]: SEQNUM=42261
> [390929.877702] bremer udevadm[27187]: KERNEL[390929.877683] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390929.877702] bremer udevadm[27187]: SEQNUM=42266
> [390929.924831] bremer udevadm[27187]: KERNEL[390929.878064] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390929.924831] bremer udevadm[27187]: SEQNUM=42267
> [390929.955790] bremer udevadm[27187]: KERNEL[390929.927585] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390929.955790] bremer udevadm[27187]: SEQNUM=42269
> [390930.020907] bremer udevadm[27187]: KERNEL[390930.011276] change   /devices/virtual/block/dm-1 (block)
> [390930.020907] bremer udevadm[27187]: SEQNUM=42270
> [390930.370889] bremer udevadm[27187]: KERNEL[390930.369901] change   /devices/virtual/block/dm-20 (block)
> [390930.370889] bremer udevadm[27187]: SEQNUM=42271
> [390930.496407] bremer udevadm[27187]: KERNEL[390930.495825] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390930.496407] bremer udevadm[27187]: SEQNUM=42272
> [390930.572262] bremer udevadm[27187]: KERNEL[390930.503861] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390930.572262] bremer udevadm[27187]: SEQNUM=42273
> [390931.166954] bremer udevadm[27187]: KERNEL[390931.166937] change   /devices/virtual/block/dm-20 (block)
> [390931.166954] bremer udevadm[27187]: SEQNUM=42274
> [390935.201018] bremer udevadm[27187]: KERNEL[390935.198872] change   /devices/virtual/block/dm-1 (block)
> [390935.201018] bremer udevadm[27187]: DM_NR_VALID_PATHS=4
> [390935.201018] bremer udevadm[27187]: SEQNUM=42275
> [390935.201018] bremer udevadm[27187]: KERNEL[390935.198928] change   /devices/virtual/block/dm-1 (block)
> [390935.201018] bremer udevadm[27187]: DM_NR_VALID_PATHS=5
> [390935.201018] bremer udevadm[27187]: SEQNUM=42276
> [390937.211383] bremer udevadm[27187]: KERNEL[390937.210550] change   /devices/virtual/block/dm-1 (block)
> [390937.211383] bremer udevadm[27187]: SEQNUM=42277
> [390937.381207] bremer udevadm[27187]: KERNEL[390937.381054] change   /devices/virtual/block/dm-1 (block)
> [390937.381207] bremer udevadm[27187]: DM_NR_VALID_PATHS=4
> [390937.381207] bremer udevadm[27187]: SEQNUM=42278
> [390937.381207] bremer udevadm[27187]: KERNEL[390937.381145] change   /devices/virtual/block/dm-1 (block)
> [390937.381207] bremer udevadm[27187]: DM_NR_VALID_PATHS=5
> [390937.381207] bremer udevadm[27187]: SEQNUM=42279
> [390937.429646] bremer udevadm[27187]: KERNEL[390937.429621] change   /devices/virtual/block/dm-20 (block)
> [390937.429646] bremer udevadm[27187]: SEQNUM=42280
> [390937.985145] bremer udevadm[27187]: KERNEL[390937.985121] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd/sdd1 (block)
> [390937.985145] bremer udevadm[27187]: SEQNUM=42285
> [390937.987026] bremer udevadm[27187]: KERNEL[390937.985775] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390937.987026] bremer udevadm[27187]: SEQNUM=42287
> [390938.015485] bremer udevadm[27187]: KERNEL[390938.015136] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf/sdf1 (block)
> [390938.015485] bremer udevadm[27187]: SEQNUM=42293
> [390938.023810] bremer udevadm[27187]: KERNEL[390938.018748] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390938.023810] bremer udevadm[27187]: SEQNUM=42295
> [390938.031063] bremer udevadm[27187]: KERNEL[390938.029535] change   /devices/virtual/block/dm-1 (block)
> [390938.031063] bremer udevadm[27187]: SEQNUM=42297
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.139772] change   /devices/virtual/block/dm-1 (block)
> [390938.446484] bremer udevadm[27187]: DM_NR_VALID_PATHS=3
> [390938.446484] bremer udevadm[27187]: SEQNUM=42298
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.140898] change   /devices/virtual/block/dm-1 (block)
> [390938.446484] bremer udevadm[27187]: DM_NR_VALID_PATHS=4
> [390938.446484] bremer udevadm[27187]: SEQNUM=42299
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.149693] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj/sdj1 (block)
> [390938.446484] bremer udevadm[27187]: SEQNUM=42304
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.237922] change   /devices/virtual/block/dm-1 (block)
> [390938.446484] bremer udevadm[27187]: DM_NR_VALID_PATHS=2
> [390938.446484] bremer udevadm[27187]: SEQNUM=42305
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.239503] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390938.446484] bremer udevadm[27187]: SEQNUM=42307
> [390938.446484] bremer udevadm[27187]: KERNEL[390938.327236] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn/sdn1 (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42313
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.334884] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42315
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.365174] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp/sdp1 (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42321
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.365980] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42323
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.409840] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr/sdr1 (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42329
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.455190] change   /devices/virtual/block/dm-1 (block)
> [390938.506363] bremer udevadm[27187]: SEQNUM=42331
> [390938.506363] bremer udevadm[27187]: KERNEL[390938.457370] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390938.525323] bremer udevadm[27187]: SEQNUM=42332
> [390938.583254] bremer udevadm[27187]: KERNEL[390938.579475] change   /devices/virtual/block/dm-1 (block)
> [390938.583254] bremer udevadm[27187]: DM_NR_VALID_PATHS=2
> [390938.583254] bremer udevadm[27187]: SEQNUM=42334
> [390938.583254] bremer udevadm[27187]: KERNEL[390938.579549] change   /devices/virtual/block/dm-1 (block)
> [390938.583254] bremer udevadm[27187]: DM_NR_VALID_PATHS=3
> [390938.583254] bremer udevadm[27187]: SEQNUM=42335
> [390938.674003] bremer udevadm[27187]: KERNEL[390938.673980] change   /devices/virtual/block/dm-1 (block)
> [390938.674003] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390938.674003] bremer udevadm[27187]: SEQNUM=42336
> [390938.726836] bremer udevadm[27187]: KERNEL[390938.726746] change   /devices/virtual/block/dm-1 (block)
> [390938.726836] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390938.726836] bremer udevadm[27187]: SEQNUM=42337
> [390938.812787] bremer udevadm[27187]: KERNEL[390938.812765] change   /devices/virtual/block/dm-1 (block)
> [390938.812787] bremer udevadm[27187]: SEQNUM=42338
> [390939.005794] bremer udevadm[27187]: KERNEL[390939.003576] change   /devices/virtual/block/dm-1 (block)
> [390939.005794] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390939.005794] bremer udevadm[27187]: SEQNUM=42339
> [390939.005794] bremer udevadm[27187]: KERNEL[390939.003669] change   /devices/virtual/block/dm-1 (block)
> [390939.005794] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390939.005794] bremer udevadm[27187]: SEQNUM=42340
> [390939.005794] bremer udevadm[27187]: KERNEL[390939.005303] change   /devices/virtual/block/dm-1 (block)
> [390939.005794] bremer udevadm[27187]: DM_NR_VALID_PATHS=2
> [390939.005794] bremer udevadm[27187]: SEQNUM=42341
> [390939.111993] bremer udevadm[27187]: KERNEL[390939.111147] change   /devices/virtual/block/dm-1 (block)
> [390939.111993] bremer udevadm[27187]: SEQNUM=42342
> [390939.118368] bremer udevadm[27187]: KERNEL[390939.115373] change   /devices/virtual/block/dm-1 (block)
> [390939.118368] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390939.118368] bremer udevadm[27187]: SEQNUM=42343
> [390939.118368] bremer udevadm[27187]: KERNEL[390939.115492] change   /devices/virtual/block/dm-1 (block)
> [390939.118368] bremer udevadm[27187]: DM_NR_VALID_PATHS=1
> [390939.118368] bremer udevadm[27187]: SEQNUM=42344
> [390939.528492] bremer udevadm[27187]: KERNEL[390939.525550] change   /devices/virtual/block/dm-1 (block)
> [390939.528492] bremer udevadm[27187]: SEQNUM=42345
> [390939.614831] bremer udevadm[27187]: KERNEL[390939.614803] change   /devices/virtual/block/dm-1 (block)
> [390939.614831] bremer udevadm[27187]: DM_NR_VALID_PATHS=0
> [390939.614831] bremer udevadm[27187]: SEQNUM=42346
> [390939.698977] bremer udevadm[27187]: KERNEL[390939.697700] change   /devices/virtual/block/dm-1 (block)
> [390939.698977] bremer udevadm[27187]: SEQNUM=42347
> [390941.621201] bremer udevadm[27187]: KERNEL[390941.619527] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390941.621201] bremer udevadm[27187]: SEQNUM=42355
> [390941.621201] bremer udevadm[27187]: KERNEL[390941.620032] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd/sdd1 (block)
> [390941.621201] bremer udevadm[27187]: SEQNUM=42356
> [390941.719531] bremer udevadm[27187]: KERNEL[390941.717815] change   /devices/virtual/block/dm-1 (block)
> [390941.719531] bremer udevadm[27187]: SEQNUM=42357
> [390942.438547] bremer udevadm[27187]: KERNEL[390942.438514] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390942.438547] bremer udevadm[27187]: SEQNUM=42365
> [390942.446220] bremer udevadm[27187]: KERNEL[390942.438581] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf/sdf1 (block)
> [390942.446220] bremer udevadm[27187]: SEQNUM=42366
> [390942.501852] bremer udevadm[27187]: KERNEL[390942.501830] change   /devices/virtual/block/dm-20 (block)
> [390942.501852] bremer udevadm[27187]: SEQNUM=42367
> [390942.558110] bremer udevadm[27187]: KERNEL[390942.555625] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390942.558110] bremer udevadm[27187]: SEQNUM=42375
> [390942.558110] bremer udevadm[27187]: KERNEL[390942.555999] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj/sdj1 (block)
> [390942.558110] bremer udevadm[27187]: SEQNUM=42376
> [390942.605523] bremer udevadm[27187]: KERNEL[390942.565430] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390942.605523] bremer udevadm[27187]: SEQNUM=42377
> [390943.122495] bremer udevadm[27187]: KERNEL[390943.122455] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390943.122495] bremer udevadm[27187]: SEQNUM=42385
> [390943.122495] bremer udevadm[27187]: KERNEL[390943.122507] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn/sdn1 (block)
> [390943.122495] bremer udevadm[27187]: SEQNUM=42386
> [390943.415924] bremer udevadm[27187]: KERNEL[390943.415181] change   /devices/virtual/block/dm-1 (block)
> [390943.415924] bremer udevadm[27187]: SEQNUM=42387
> [390943.591209] bremer udevadm[27187]: KERNEL[390943.591188] change   /devices/virtual/block/dm-20 (block)
> [390943.591209] bremer udevadm[27187]: SEQNUM=42388
> [390943.952947] bremer udevadm[27187]: KERNEL[390943.951985] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390943.952947] bremer udevadm[27187]: SEQNUM=42396
> [390943.952947] bremer udevadm[27187]: KERNEL[390943.952643] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp/sdp1 (block)
> [390943.952947] bremer udevadm[27187]: SEQNUM=42397
> [390944.162459] bremer udevadm[27187]: KERNEL[390944.161005] change   /devices/virtual/block/dm-1 (block)
> [390944.162459] bremer udevadm[27187]: SEQNUM=42398
> [390944.327919] bremer udevadm[27187]: KERNEL[390944.327896] change   /devices/virtual/block/dm-1 (block)
> [390944.327919] bremer udevadm[27187]: SEQNUM=42399
> [390944.462480] bremer udevadm[27187]: KERNEL[390944.450906] change   /devices/virtual/block/dm-1 (block)
> [390944.462480] bremer udevadm[27187]: SEQNUM=42400
> [390944.617185] bremer udevadm[27187]: KERNEL[390944.617111] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390944.617185] bremer udevadm[27187]: SEQNUM=42408
> [390944.617185] bremer udevadm[27187]: KERNEL[390944.617177] add      /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr/sdr1 (block)
> [390944.617185] bremer udevadm[27187]: SEQNUM=42409
> [390944.671978] bremer udevadm[27187]: KERNEL[390944.659043] change   /devices/virtual/block/dm-1 (block)
> [390944.671978] bremer udevadm[27187]: SEQNUM=42410
> [390946.022466] bremer udevadm[27187]: KERNEL[390946.020770] change   /devices/virtual/block/dm-1 (block)
> [390946.022466] bremer udevadm[27187]: SEQNUM=42411
> [390952.494777] bremer udevadm[27187]: KERNEL[390952.494627] remove   /devices/virtual/block/dm-20 (block)
> [390952.494777] bremer udevadm[27187]: SEQNUM=42412
> [390952.506439] bremer udevadm[27187]: KERNEL[390952.501083] remove   /devices/virtual/block/dm-20 (block)
> [390952.506439] bremer udevadm[27187]: SEQNUM=42414
> [390952.583668] bremer udevadm[27187]: KERNEL[390952.583616] change   /devices/virtual/block/dm-1 (block)
> [390952.583668] bremer udevadm[27187]: SEQNUM=42415
> [390954.455934] bremer udevadm[27187]: KERNEL[390954.455883] change   /devices/virtual/block/dm-1 (block)
> [390954.455934] bremer udevadm[27187]: SEQNUM=42416
> [390954.531979] bremer udevadm[27187]: KERNEL[390954.531953] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd/sdd1 (block)
> [390954.531979] bremer udevadm[27187]: SEQNUM=42417
> [390954.550602] bremer udevadm[27187]: KERNEL[390954.550566] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session1/target7:0:0/7:0:0:1/block/sdd (block)
> [390954.550602] bremer udevadm[27187]: SEQNUM=42418
> [390954.581518] bremer udevadm[27187]: KERNEL[390954.581464] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf/sdf1 (block)
> [390954.581518] bremer udevadm[27187]: SEQNUM=42419
> [390954.590478] bremer udevadm[27187]: KERNEL[390954.589744] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.4/host7/session2/target7:0:1/7:0:1:1/block/sdf (block)
> [390954.590478] bremer udevadm[27187]: SEQNUM=42420
> [390954.627454] bremer udevadm[27187]: KERNEL[390954.627047] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj/sdj1 (block)
> [390954.627454] bremer udevadm[27187]: SEQNUM=42421
> [390954.638348] bremer udevadm[27187]: KERNEL[390954.637967] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-2/target9:0:2/9:0:2:1/block/sdj (block)
> [390954.638348] bremer udevadm[27187]: SEQNUM=42422
> [390954.674020] bremer udevadm[27187]: KERNEL[390954.673998] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn/sdn1 (block)
> [390954.674699] bremer udevadm[27187]: SEQNUM=42423
> [390954.711117] bremer udevadm[27187]: KERNEL[390954.710629] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-5/target9:0:5/9:0:5:1/block/sdn (block)
> [390954.711117] bremer udevadm[27187]: SEQNUM=42424
> [390954.726214] bremer udevadm[27187]: KERNEL[390954.726194] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp/sdp1 (block)
> [390954.726214] bremer udevadm[27187]: SEQNUM=42425
> [390954.735782] bremer udevadm[27187]: KERNEL[390954.735747] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-6/target9:0:6/9:0:6:1/block/sdp (block)
> [390954.735782] bremer udevadm[27187]: SEQNUM=42426
> [390954.778212] bremer udevadm[27187]: KERNEL[390954.778190] remove   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr/sdr1 (block)
> [390954.778212] bremer udevadm[27187]: SEQNUM=42427
> [390954.783988] bremer udevadm[27187]: KERNEL[390954.783952] change   /devices/pci0000:00/0000:00:01.0/0000:07:00.6/host9/rport-9:0-7/target9:0:7/9:0:7:1/block/sdr (block)
> [390954.783988] bremer udevadm[27187]: SEQNUM=42428

You are receiving this mail because: