[opensuse] Disk i/o very unresponsive?
I do a lot of heavy USB-3 disk i/o, but today I'm throwing in a drive connected via eSata. This is with a laptop that I use all the time for disk i/o intensive tasks. I've got the equivalent of: dd if=/dev/eSata_drive of=/dev/USB3_drive bs=4kb going on. (I don't know what bs my app is actually using.) My throughput is around 38 MB/sec which is surprisingly slow, but not crazy slow. More surprising is the laptop otherwise acts almost frozen. I had done some work on another USB-3 drive. I issued a "umount" command to it about 15 minutes ago and it still hasn't unmounted. Or at least I don't think it has. I can't even use alt-F2 or contrl-alt-F2 to get back to the virtual console. I had also tried to log into virtual console 4. After 5 minutes it had not logged in. As it stands the only thing I can do is observe virtual console 3. I'm getting status updates and it claims my copy task will be done in 45 minutes or so. I hope so, I'd like to be able to use that PC again. Greg -- Greg Freemyer -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On Tue, May 12, 2015 at 12:52 PM, Greg Freemyer <greg.freemyer@gmail.com> wrote:
I do a lot of heavy USB-3 disk i/o, but today I'm throwing in a drive connected via eSata.
This is with a laptop that I use all the time for disk i/o intensive tasks.
I've got the equivalent of:
dd if=/dev/eSata_drive of=/dev/USB3_drive bs=4kb
going on. (I don't know what bs my app is actually using.)
My throughput is around 38 MB/sec which is surprisingly slow, but not crazy slow.
More surprising is the laptop otherwise acts almost frozen. I had done some work on another USB-3 drive. I issued a "umount" command to it about 15 minutes ago and it still hasn't unmounted.
Or at least I don't think it has. I can't even use alt-F2 or contrl-alt-F2 to get back to the virtual console.
I had also tried to log into virtual console 4. After 5 minutes it had not logged in.
As it stands the only thing I can do is observe virtual console 3. I'm getting status updates and it claims my copy task will be done in 45 minutes or so.
I hope so, I'd like to be able to use that PC again.
10 minutes later and I can move between virtual consoles again. And the umount completed. But the machine is still very non-responsive to anything disk i/o related. Greg -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
В Tue, 12 May 2015 13:09:18 -0400 Greg Freemyer <greg.freemyer@gmail.com> пишет:
On Tue, May 12, 2015 at 12:52 PM, Greg Freemyer <greg.freemyer@gmail.com> wrote:
I do a lot of heavy USB-3 disk i/o, but today I'm throwing in a drive connected via eSata.
This is with a laptop that I use all the time for disk i/o intensive tasks.
I've got the equivalent of:
dd if=/dev/eSata_drive of=/dev/USB3_drive bs=4kb
going on. (I don't know what bs my app is actually using.)
My throughput is around 38 MB/sec which is surprisingly slow, but not crazy slow.
More surprising is the laptop otherwise acts almost frozen. I had done some work on another USB-3 drive. I issued a "umount" command to it about 15 minutes ago and it still hasn't unmounted.
Or at least I don't think it has. I can't even use alt-F2 or contrl-alt-F2 to get back to the virtual console.
I had also tried to log into virtual console 4. After 5 minutes it had not logged in.
As it stands the only thing I can do is observe virtual console 3. I'm getting status updates and it claims my copy task will be done in 45 minutes or so.
I hope so, I'd like to be able to use that PC again.
10 minutes later and I can move between virtual consoles again. And the umount completed.
But the machine is still very non-responsive to anything disk i/o related.
Does "dd ... oflag=direct" make any difference? What /proc/meminfo says when this happens? -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On 05/12/2015 10:09 AM, Greg Freemyer wrote:
On Tue, May 12, 2015 at 12:52 PM, Greg Freemyer <greg.freemyer@gmail.com> wrote: ..... 10 minutes later and I can move between virtual consoles again. And the umount completed.
But the machine is still very non-responsive to anything disk i/o related.
Greg
But if you are done with the usb you could reboot, or sniff around to see where the cycles are being spent. Sometimes usb mounts in a "safe to remove" (I forget the actual name) mode that causes slowness because each write is followed by a close and reopen. Works great for small files, but horrible on larger moves. I've seen this both on windows and linux. Especially if any form of automount was involved. I always unmount the auto mount and use my own mount command for large transfers like backups etc. -- After all is said and done, more is said than done. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Greg Freemyer composed on 2015-05-12 13:09 (UTC-0400):
Greg Freemyer wrote:
I do a lot of heavy USB-3 disk i/o, but today I'm throwing in a drive connected via eSata.
Motherboard eSATA? PCMCIA card ports? Same questions for USB ports. Provide lspci output regardless. Could be resource conflict if PCMCIA card(s) is/are involved.
This is with a laptop that I use all the time for disk i/o intensive tasks. -- "The wise are known for their understanding, and pleasant words are persuasive." Proverbs 16:21 (New Living Translation)
Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata *** http://fm.no-ip.com/ -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On Tue, May 12, 2015 at 1:31 PM, Felix Miata <mrmazda@earthlink.net> wrote:
Greg Freemyer composed on 2015-05-12 13:09 (UTC-0400):
Greg Freemyer wrote:
I do a lot of heavy USB-3 disk i/o, but today I'm throwing in a drive connected via eSata.
Motherboard eSATA? PCMCIA card ports?
Motherboard for both eSata and USB. It's a Dell XPS laptop that is about 3 years old. 2 USB3 ports and a combo eSata / USB2 port.
Same questions for USB ports.
Provide lspci output regardless.
00:00.0 Host bridge: Intel Corporation 2nd Generation Core Processor Family DRAM Controller (rev 09) 00:01.0 PCI bridge: Intel Corporation Xeon E3-1200/2nd Generation Core Processor Family PCI Express Root Port (rev 09) 00:02.0 VGA compatible controller: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller (rev 09) 00:16.0 Communication controller: Intel Corporation 6 Series/C200 Series Chipset Family MEI Controller #1 (rev 04) 00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05) 00:1b.0 Audio device: Intel Corporation 6 Series/C200 Series Chipset Family High Definition Audio Controller (rev 05) 00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5) 00:1c.1 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 2 (rev b5) 00:1c.3 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 4 (rev b5) 00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5) 00:1c.5 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 6 (rev b5) 00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05) 00:1f.0 ISA bridge: Intel Corporation HM67 Express Chipset Family LPC Controller (rev 05) 00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family 6 port SATA AHCI Controller (rev 05) 00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 05) 01:00.0 VGA compatible controller: NVIDIA Corporation GF108M [GeForce GT 540M] (rev a1) 03:00.0 Network controller: Intel Corporation Centrino Wireless-N 1030 [Rainbow Peak] (rev 34) 04:00.0 USB controller: NEC Corporation uPD720200 USB 3.0 Host Controller (rev 04) 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
Could be resource conflict if PCMCIA card(s) is/are involved.
No PCMCIA as an option for this laptop that I know of. I rebooted. Even after my "copy" finished the laptop wasn't behaving well. It had been isolated from all networks but when I connected up a cat5 cable so I could provide the above lspci output, it would not grab a IP via DHCP. After reboot I was able to get the cat5 cable to work with no issue. Greg -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2015-05-12 20:21, Greg Freemyer wrote:
I rebooted. Even after my "copy" finished the laptop wasn't behaving well. It had been isolated from all networks but when I connected up a cat5 cable so I could provide the above lspci output, it would not grab a IP via DHCP. After reboot I was able to get the cat5 cable to work with no issue.
A large copy job, specially over USB, exhausts about the entire RAM for cache usage, making the entire system crawl (specially so if it swaps). Also any other i/o is starved of cache. Quite peculiar. That's why Andrei asks about the "oflag=direct" thing, I guess. You can make your machine more responsive, somewhat, by using ionice with iddle priority on the culprit process. - -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" (Minas Tirith)) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) iF4EAREIAAYFAlVSuqIACgkQja8UbcUWM1wAIgEAkZOgxnk7MHkDpa7m7yISUDWc 5TFUHhTc/SawFqQzAkQA/0yQ1CUYCvPoJSSVUxwrn2imu/P41jiurYwfUAgpd8IM =B70H -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
participants (5)
-
Andrei Borzenkov -
Carlos E. R. -
Felix Miata -
Greg Freemyer -
John Andersen