Mailinglist Archive: opensuse (1470 mails)

< Previous Next >
Re: [opensuse] experiences with bache / logic of caching
  • From: Per Jessen <per@xxxxxxxxxxxx>
  • Date: Thu, 18 Feb 2016 12:33:24 +0100
  • Message-id: <na4a65$tq0$>
Greg Freemyer wrote:

On Wed, Feb 17, 2016 at 12:08 PM, Per Jessen <per@xxxxxxxxxxxx> wrote:
Greg Freemyer wrote:

On Wed, Feb 17, 2016 at 7:03 AM, Per Jessen <per@xxxxxxxxxxxx> wrote:
Andrei Borzenkov wrote:

On Wed, Feb 17, 2016 at 2:28 PM, Per Jessen <per@xxxxxxxxxxxx> wrote:

I'll have to check, but I don't think adding memory will do much.
The filesystems cache is not used because there are no filesystems in
use - the raw disk space is handed out over iSCSI, just as Greg

Caches are per-block device, so unless you are using devices for
direct IO they should still benefit from RAM caches.

Each storage server has 4Gb, expandable to 32Gb afaict - but ietd does
use direct IO. (type=blockio). I think I need to check up on fileio
blockio. Adding some more RAM is a lot easier than adding a bcache.

The purpose of O_DIRECT is to move the cache handling from kernel
space to userspace. Does ietd not implement a cache in user space?

Almost certainly not - that would somewhat negate the idea of using
direct IO. Still, I think it's an implementation left-over from years
back. I have not found any reason for using blockio vs fileio (those are
the two terms used by ietd), but I'll have to test it.


We may be talking about different things.

The device /dev/sdx can be directly opened as a block device and it
can perform blockio. By default I'm pretty sure the kernel would
provide a cache for it.

ietd uses "blockio" and "fileio" like this:

In fileio mode (default), it defines a mapping between a "Logical Unit
Number" <lun> and a given device <device> , which can be any block device
(including regular block devices like hdX and sdX and virtual block devices
like LVM and Software RAID devices) or regular files.

In blockio mode, it defines a mapping between a "Logical Unit Number" <lun>
and a given block device <device>. This mode will perform direct block i/o
with the device, bypassing page-cache for all operations. This allows for
efficient handling of non-aligned sector transfers (virtualized
environments) and large block transfers (media servers). This mode
works ideally with high-end storage HBAs and for applications that either do
not need caching between application and disk or need the large block

Judging by that, blockio is the appropriate mode, but adding memory to the
storage server will not help at all.


To unsubscribe, e-mail: opensuse+unsubscribe@xxxxxxxxxxxx
To contact the owner, e-mail: opensuse+owner@xxxxxxxxxxxx

< Previous Next >
Follow Ups