public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
* [gentoo-user] XFS FileSystem - Slow Writes
@ 2006-08-29  4:03 Ow Mun Heng
  2006-08-29  4:25 ` Jason Weisberger
                   ` (2 more replies)
  0 siblings, 3 replies; 21+ messages in thread
From: Ow Mun Heng @ 2006-08-29  4:03 UTC (permalink / raw
  To: gentoo

Has anyone here, who uses XFS fs, experiencing slow filesystem writes?
I'm seeing throughput of like 4-3MB/s instead of like previously
15-20MB/s. 
I have read that there was some thing about "barriers" and I've tried
re-mounting the FS w/ "nobarriers" but the performance didn't improve.

I've already fscked the fs w/ the latest xfsprogs (> 2.8.0) to no good
effect.

Anyone has any clue or suggestions? Else, I'm gonna go and change the FS
back to EXT3.

BTW: it's my /home which is XFS which houses GIGs of Mbox files as well
as VMware images.


-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  4:03 [gentoo-user] XFS FileSystem - Slow Writes Ow Mun Heng
@ 2006-08-29  4:25 ` Jason Weisberger
  2006-08-29  6:11 ` Mark Kirkwood
  2006-08-29  9:37 ` Richard Fish
  2 siblings, 0 replies; 21+ messages in thread
From: Jason Weisberger @ 2006-08-29  4:25 UTC (permalink / raw
  To: gentoo-user

[-- Attachment #1: Type: text/plain, Size: 567 bytes --]

Hello,

I just had the same problem.  I switched to XFS about two weeks ago, and all
I've heard out of my hard drive since then is churning and grinding.
Untarring large files is multitudes slower, even a simple emerge --sync
takes extra time.  Booting was also much slower.  I never measured
throughput, but it was bad enough that a benchmark was not needed to confirm
it.  Previously I had been using ext3 with no problems, no hard drive
churning.  I switched from xfs to reiser4 today out of frusteration...
Problem solved.

-- 
Jason Weisberger
jbdubbs@gmail.com

[-- Attachment #2: Type: text/html, Size: 656 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  4:03 [gentoo-user] XFS FileSystem - Slow Writes Ow Mun Heng
  2006-08-29  4:25 ` Jason Weisberger
@ 2006-08-29  6:11 ` Mark Kirkwood
  2006-08-29  6:37   ` Ow Mun Heng
  2006-08-29  9:37 ` Richard Fish
  2 siblings, 1 reply; 21+ messages in thread
From: Mark Kirkwood @ 2006-08-29  6:11 UTC (permalink / raw
  To: gentoo-user

Ow Mun Heng wrote:
> Has anyone here, who uses XFS fs, experiencing slow filesystem writes?
> I'm seeing throughput of like 4-3MB/s instead of like previously
> 15-20MB/s. 
> I have read that there was some thing about "barriers" and I've tried
> re-mounting the FS w/ "nobarriers" but the performance didn't improve.
> 
> I've already fscked the fs w/ the latest xfsprogs (> 2.8.0) to no good
> effect.
> 
> Anyone has any clue or suggestions? Else, I'm gonna go and change the FS
> back to EXT3.
> 
> BTW: it's my /home which is XFS which houses GIGs of Mbox files as well
> as VMware images.
> 
> 

What is your kernel version? (could be important).

I'm using 2.7.11 on kernel 2.6.16, write performance is reasonably good 
- 100 Mb/s on a 4 disk raid0 array (in fact I could probably do better 
if the promise driver would let me run the disks at udma5 instead of 
udma6....)


Cheers

Mark
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  6:11 ` Mark Kirkwood
@ 2006-08-29  6:37   ` Ow Mun Heng
  2006-08-30  1:23     ` Mark Kirkwood
  0 siblings, 1 reply; 21+ messages in thread
From: Ow Mun Heng @ 2006-08-29  6:37 UTC (permalink / raw
  To: gentoo-user

On Tue, 2006-08-29 at 18:11 +1200, Mark Kirkwood wrote:
> Ow Mun Heng wrote:
> > Has anyone here, who uses XFS fs, experiencing slow filesystem writes?
> > I'm seeing throughput of like 4-3MB/s instead of like previously
> > 15-20MB/s. 
> > I have read that there was some thing about "barriers" and I've tried
> > re-mounting the FS w/ "nobarriers" but the performance didn't improve.
> > 
> > I've already fscked the fs w/ the latest xfsprogs (> 2.8.0) to no good
> > effect.
> > 
> > Anyone has any clue or suggestions? Else, I'm gonna go and change the FS
> > back to EXT3.
> > 
> > BTW: it's my /home which is XFS which houses GIGs of Mbox files as well
> > as VMware images.
> > 
> > 
> 
> What is your kernel version? (could be important).

I've already updated it to the latest based on the suspend2 version.
$uname -r
2.6.17-suspend2-r4

$eix xfsprogs
     Available versions:  2.7.3 2.7.11 2.8.10
     Installed:           2.8.10


> 
> I'm using 2.7.11 on kernel 2.6.16, write performance is reasonably good 

If not mistaken, the issue, (or barriers if not mistaken) was introduced
in the 2.6.17 kernel series.
the 2.6.16 series wasn't affected. (I could be wrong, I don't have net
access so, I can't verify)

-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  4:03 [gentoo-user] XFS FileSystem - Slow Writes Ow Mun Heng
  2006-08-29  4:25 ` Jason Weisberger
  2006-08-29  6:11 ` Mark Kirkwood
@ 2006-08-29  9:37 ` Richard Fish
  2006-08-29  9:55   ` Mick
       [not found]   ` <1156845176.2843.24.camel@neuromancer.home.net>
  2 siblings, 2 replies; 21+ messages in thread
From: Richard Fish @ 2006-08-29  9:37 UTC (permalink / raw
  To: gentoo-user

On 8/28/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> Has anyone here, who uses XFS fs, experiencing slow filesystem writes?
> I'm seeing throughput of like 4-3MB/s instead of like previously
> 15-20MB/s.
> I have read that there was some thing about "barriers" and I've tried
> re-mounting the FS w/ "nobarriers" but the performance didn't improve.

Hmm, nothing that I have seen.  I'm running 2.6.18-rc2.  My xfs
settings look like:

carcharias rjf # sysctl -a | grep xfs
fs.xfs.stats_clear = 0
fs.xfs.inherit_nodefrag = 1
fs.xfs.rotorstep = 1
fs.xfs.inherit_nosymlinks = 0
fs.xfs.age_buffer_centisecs = 1500
fs.xfs.xfsbufd_centisecs = 100
fs.xfs.inherit_noatime = 1
fs.xfs.inherit_nodump = 1
fs.xfs.inherit_sync = 1
fs.xfs.xfssyncd_centisecs = 500
fs.xfs.error_level = 3
fs.xfs.panic_mask = 0
fs.xfs.irix_symlink_mode = 0
fs.xfs.irix_sgid_inherit = 0
fs.xfs.restrict_chown = 1

I would make sure you are not mounting with the sync option, or have
anything with the sync flag set (chattr/lsattr).  I have seen that
result in performance like you describe...

-Richard
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  9:37 ` Richard Fish
@ 2006-08-29  9:55   ` Mick
  2006-08-29  9:58     ` Justin Piszcz
       [not found]   ` <1156845176.2843.24.camel@neuromancer.home.net>
  1 sibling, 1 reply; 21+ messages in thread
From: Mick @ 2006-08-29  9:55 UTC (permalink / raw
  To: gentoo-user

[-- Attachment #1: Type: text/plain, Size: 172 bytes --]

On Tuesday 29 August 2006 10:37, Richard Fish wrote:

> fs.xfs.xfssyncd_centisecs = 500

Mine is set at 3000 by default, why is yours set at 500?
-- 
Regards,
Mick

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  9:55   ` Mick
@ 2006-08-29  9:58     ` Justin Piszcz
  0 siblings, 0 replies; 21+ messages in thread
From: Justin Piszcz @ 2006-08-29  9:58 UTC (permalink / raw
  To: gentoo-user

There are a number of things you can do to speed up XFS.

# <file system> <mount point>   <type>  <options>       <dump>  <pass>
/dev/sda2       /               xfs 
logbufs=8,logbsize=262144,biosize=16,noatime,nodiratime   0       1

Try this :)


On Tue, 29 Aug 2006, Mick wrote:

> On Tuesday 29 August 2006 10:37, Richard Fish wrote:
>
>> fs.xfs.xfssyncd_centisecs = 500
>
> Mine is set at 3000 by default, why is yours set at 500?
> -- 
> Regards,
> Mick
>
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
       [not found]   ` <1156845176.2843.24.camel@neuromancer.home.net>
@ 2006-08-29 17:54     ` Richard Fish
  2006-08-29 22:10       ` Ow Mun Heng
       [not found]     ` <7573e9640608291055p313ccac8m65a1523b5ad03a37@mail.gmail.com>
  2006-08-30  1:35     ` Richard Fish
  2 siblings, 1 reply; 21+ messages in thread
From: Richard Fish @ 2006-08-29 17:54 UTC (permalink / raw
  To: gentoo-user

On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> So.. it doesn't give me any clues there. However, doing Reads is OK. I
> get good performance when eg: copying a file from the XFS partition to
> another partition/drive.

How about the output of:

lsattr -Ra /home 2>dev/null | grep -v -e "-------------" -e ":$" -e "^$"

This should produce nothing.

-Richard
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
       [not found]     ` <7573e9640608291055p313ccac8m65a1523b5ad03a37@mail.gmail.com>
@ 2006-08-29 18:03       ` Jeff Grant
  2006-08-29 18:13         ` Richard Fish
  0 siblings, 1 reply; 21+ messages in thread
From: Jeff Grant @ 2006-08-29 18:03 UTC (permalink / raw
  To: gentoo-user

http://www.debian-administration.org/articles/388

and

http://linuxgazette.net/122/TWDT.html#piszcz

These are two articles that indeed led me to believe that XFS was the
way to go - and here, I'm also experiencing some dreadful performance -
tar/untar performance specifically.

What to do.. .what to do...

-Jeff

Richard Fish wrote:
> On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
>> So.. it doesn't give me any clues there. However, doing Reads is OK. I
>> get good performance when eg: copying a file from the XFS partition to
>> another partition/drive.
> 
> Also, is the filesystem getting full?
> 
> -Richard

-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29 18:03       ` Jeff Grant
@ 2006-08-29 18:13         ` Richard Fish
  2006-08-29 18:22           ` Jeff Grant
  0 siblings, 1 reply; 21+ messages in thread
From: Richard Fish @ 2006-08-29 18:13 UTC (permalink / raw
  To: gentoo-user

On 8/29/06, Jeff Grant <jgrant@voicesignal.com> wrote:
> These are two articles that indeed led me to believe that XFS was the
> way to go - and here, I'm also experiencing some dreadful performance -
> tar/untar performance specifically.

Can you define "dreadful"?  Are you seeing the same results (fast
reads but slow writes) as Ow?

-Richard
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29 18:13         ` Richard Fish
@ 2006-08-29 18:22           ` Jeff Grant
  0 siblings, 0 replies; 21+ messages in thread
From: Jeff Grant @ 2006-08-29 18:22 UTC (permalink / raw
  To: gentoo-user

[-- Attachment #1: Type: text/plain, Size: 661 bytes --]

You are correct, sir. Read times move at a nice clip - but untar/writes
seem to get cut almost in half. Just an observation - as I do not have
any solid data analysis atm - just a matter of scratching my skull
whilst I listen to what seems to be some serious HD churning.

-Jeff

Richard Fish wrote:
> On 8/29/06, Jeff Grant <jgrant@voicesignal.com> wrote:
>> These are two articles that indeed led me to believe that XFS was the
>> way to go - and here, I'm also experiencing some dreadful performance -
>> tar/untar performance specifically.
> 
> Can you define "dreadful"?  Are you seeing the same results (fast
> reads but slow writes) as Ow?
> 
> -Richard

[-- Attachment #2: jgrant.vcf --]
[-- Type: text/x-vcard, Size: 355 bytes --]

begin:vcard
fn:Jeff Grant
n:Grant;Jeff
org:VoiceSignal;Information Technology
adr:;;150 Presidential Way;Woburn;MA;01801;USA
email;internet:jgrant@voicesignal.com
title:Linux System Administrator
tel;work:(781)970-5209
tel;fax:(781)970-5200
tel;cell:(978)407-9512
x-mozilla-html:FALSE
url:http://www.voicesignal.com/
version:2.1
end:vcard


^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29 17:54     ` Richard Fish
@ 2006-08-29 22:10       ` Ow Mun Heng
  0 siblings, 0 replies; 21+ messages in thread
From: Ow Mun Heng @ 2006-08-29 22:10 UTC (permalink / raw
  To: gentoo-user

On Tue, 2006-08-29 at 10:54 -0700, Richard Fish wrote:
> On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> > So.. it doesn't give me any clues there. However, doing Reads is OK. I
> > get good performance when eg: copying a file from the XFS partition to
> > another partition/drive.
> 
> How about the output of:
> 
> lsattr -Ra /home 2>dev/null | grep -v -e "-------------" -e ":$" -e "^$"
> 
> This should produce nothing.

And you are right. It produces nothing.

The FS is now 80% Full
Filesystem            Size  Used Avail Use% Mounted on
/dev/hda6              20G   16G  4.1G  80% /home

I think I'm gonna try re-formatting the drive/partition once more.
(There _may_ be latent curruption which I'm not aware off since I just
stuck a USB 200G drive w/XFS and read/write performance is Zippy.)

I'll report it once I get to it.



-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-29  6:37   ` Ow Mun Heng
@ 2006-08-30  1:23     ` Mark Kirkwood
  2006-08-30 23:23       ` Mark Kirkwood
  0 siblings, 1 reply; 21+ messages in thread
From: Mark Kirkwood @ 2006-08-30  1:23 UTC (permalink / raw
  To: gentoo-user

Ow Mun Heng wrote:
>
> I've already updated it to the latest based on the suspend2 version.
> $uname -r
> 2.6.17-suspend2-r4
> 
> $eix xfsprogs
>      Available versions:  2.7.3 2.7.11 2.8.10
>      Installed:           2.8.10
> 
> 
> If not mistaken, the issue, (or barriers if not mistaken) was introduced
> in the 2.6.17 kernel series.
> the 2.6.16 series wasn't affected. (I could be wrong, I don't have net
> access so, I can't verify)
> 

Right - as it happens I'm doing an update today, so will let you know if 
   I see any write performance change.

Cheers

Mark
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
       [not found]   ` <1156845176.2843.24.camel@neuromancer.home.net>
  2006-08-29 17:54     ` Richard Fish
       [not found]     ` <7573e9640608291055p313ccac8m65a1523b5ad03a37@mail.gmail.com>
@ 2006-08-30  1:35     ` Richard Fish
  2006-08-30  2:05       ` [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? Ow Mun Heng
       [not found]       ` <200608300951.58922.michaelkintzios@gmail.com>
  2 siblings, 2 replies; 21+ messages in thread
From: Richard Fish @ 2006-08-30  1:35 UTC (permalink / raw
  To: gentoo-user

On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> $ mount  | grep xfs
> /dev/hda6 on /home type xfs (rw)

Hmm, I missed this before.  "nobarrier" should be showing up here.  Try:

mount /home -o remount,nobarrier

-Richard
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue?
  2006-08-30  1:35     ` Richard Fish
@ 2006-08-30  2:05       ` Ow Mun Heng
  2006-08-30 16:38         ` Joshua Schmidlkofer
       [not found]       ` <200608300951.58922.michaelkintzios@gmail.com>
  1 sibling, 1 reply; 21+ messages in thread
From: Ow Mun Heng @ 2006-08-30  2:05 UTC (permalink / raw
  To: gentoo-user

On Tue, 2006-08-29 at 18:35 -0700, Richard Fish wrote:
> On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> > $ mount  | grep xfs
> > /dev/hda6 on /home type xfs (rw)
> 
> Hmm, I missed this before.  "nobarrier" should be showing up here.  Try:
> 
> mount /home -o remount,nobarrier
> 

I did mention that I tried that as well. (but I just re-tried it anyway)
and it didn't have any changes.

Out of curiousity, I just tried to copy a file using an xterm (instead
of using nautilus) from DIsk 2 to disk1

disk2/partition2 - VFAT
disk1/partition6 - XFS partition (/home)


$ ls -lah WinXP-000001-cl1-000001-cl1-000001-s002.vmdk           
-rwxrwxrwx  1 root root 620M Aug 29 19:10
WinXP-000001-cl1-000001-cl1-000001-s002.vmdk

$ time cp WinXP-000001-cl1-000001-cl1-000001-s001.vmdk ~/Desktop/
real    0m37.353s
user    0m0.157s
sys     0m5.445s


Transfer rate ~16.8MB/s

Using Nautilus (I don't know of a good way to measure throughput using
this, so it's basically what I see in the progress bar
~5min
gkrellm2 notes transfer rate ~2.0MB/s


However, doing the same thing to my /tmp directory (ext3 partition) the
same file copies in ~30secs and w/ ~17MB/s transfer rate.

What gives??


BTW, what's the difference between mc and mc-mp??

*  app-misc/mc
      Latest version available: 4.6.1
      Latest version installed: [ Not Installed ]
      Size of downloaded files: 11,606 kB
      Homepage:    http://www.ibiblio.org/mc/
      Description: GNU Midnight Commander cli-based file manager
      License:     GPL-2

*  app-misc/mc-mp [ Masked ]
      Latest version available: 4.1.40_pre9
      Latest version installed: [ Not Installed ]
      Size of downloaded files: 2,904 kB
      Homepage:    http://mc.linuxinside.com/cgi-bin/dir.cgi
      Description: GNU Midnight Commander cli-based file manager. 4.1.x
branch
      License:     GPL-2


> -Richard

-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
       [not found]       ` <200608300951.58922.michaelkintzios@gmail.com>
@ 2006-08-30  8:52         ` Justin Piszcz
  2006-08-30  9:27         ` Richard Fish
  1 sibling, 0 replies; 21+ messages in thread
From: Justin Piszcz @ 2006-08-30  8:52 UTC (permalink / raw
  To: gentoo-user

nobarrier went into 2.6.17 I believe (kernel related change) and was 
discussed on the XFS mailing list.

On Wed, 30 Aug 2006, Mick wrote:

> On Wednesday 30 August 2006 02:35, Richard Fish wrote:
>> On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
>>> $ mount  | grep xfs
>>> /dev/hda6 on /home type xfs (rw)
>>
>> Hmm, I missed this before.  "nobarrier" should be showing up here.  Try:
>>
>> mount /home -o remount,nobarrier
>
> Where did you find this option?!  Couldn't see it in man mount . . .
>
> -- 
> Regards,
> Mick
>
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
       [not found]       ` <200608300951.58922.michaelkintzios@gmail.com>
  2006-08-30  8:52         ` [gentoo-user] XFS FileSystem - Slow Writes Justin Piszcz
@ 2006-08-30  9:27         ` Richard Fish
  1 sibling, 0 replies; 21+ messages in thread
From: Richard Fish @ 2006-08-30  9:27 UTC (permalink / raw
  To: gentoo-user

On 8/30/06, Mick <michaelkintzios@gmail.com> wrote:
> On Wednesday 30 August 2006 02:35, Richard Fish wrote:
> > On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> > > $ mount  | grep xfs
> > > /dev/hda6 on /home type xfs (rw)
> >
> > Hmm, I missed this before.  "nobarrier" should be showing up here.  Try:
> >
> > mount /home -o remount,nobarrier
>
> Where did you find this option?!  Couldn't see it in man mount . . .

http://oss.sgi.com/projects/xfs/faq.html#wcache_fix

-Richard
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue?
  2006-08-30  2:05       ` [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? Ow Mun Heng
@ 2006-08-30 16:38         ` Joshua Schmidlkofer
  2006-08-31  3:37           ` [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? (SOLVED w/ ReFORMAT) Ow Mun Heng
  0 siblings, 1 reply; 21+ messages in thread
From: Joshua Schmidlkofer @ 2006-08-30 16:38 UTC (permalink / raw
  To: gentoo-user

On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> On Tue, 2006-08-29 at 18:35 -0700, Richard Fish wrote:
> > On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:
> > > $ mount  | grep xfs
> > > /dev/hda6 on /home type xfs (rw)
> >
> > Hmm, I missed this before.  "nobarrier" should be showing up here.  Try:
> >
> > mount /home -o remount,nobarrier
> >
>
> I did mention that I tried that as well. (but I just re-tried it anyway)
> and it didn't have any changes.

I don't think it's a good idea.  Do you know what the write barriers
provide?   They give you a much higher chance of no damage if you are
able ot run with barriers.  The only real danger to an XFS partition
is out-of-order commits (and of course massive hardware failure).
Write barriers prevent out-of-order journal vs. FS commits, and that
is a Good Thing(tm).


They are only in as of 2.6.17 for XFS.

>
> Out of curiousity, I just tried to copy a file using an xterm (instead
> of using nautilus) from DIsk 2 to disk1
>
> disk2/partition2 - VFAT
> disk1/partition6 - XFS partition (/home)
>
>
> $ ls -lah WinXP-000001-cl1-000001-cl1-000001-s002.vmdk
> -rwxrwxrwx  1 root root 620M Aug 29 19:10
> WinXP-000001-cl1-000001-cl1-000001-s002.vmdk
>
> $ time cp WinXP-000001-cl1-000001-cl1-000001-s001.vmdk ~/Desktop/
> real    0m37.353s
> user    0m0.157s
> sys     0m5.445s
>
>
> Transfer rate ~16.8MB/s

I read an article recently (<2 years ago , heh)  about how Nautilus,
mc, Cp and other OSS copy utilities suffer from a lack of real
intuitive optimization work.  They highlighted the GNU cp command.
Overall copying with Linux tends to be lack luster.  It's services we
do well.  i.e. Http, SQL, etc.  So, that begs the question: Are there
any good, well optimized file copy utilities for Linux?

>
> Using Nautilus (I don't know of a good way to measure throughput using
> this, so it's basically what I see in the progress bar
> ~5min
> gkrellm2 notes transfer rate ~2.0MB/s
>
>
> However, doing the same thing to my /tmp directory (ext3 partition) the
> same file copies in ~30secs and w/ ~17MB/s transfer rate.
>
> What gives??
>
>
> BTW, what's the difference between mc and mc-mp??
>
> *  app-misc/mc
>       Latest version available: 4.6.1
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 11,606 kB
>       Homepage:    http://www.ibiblio.org/mc/
>       Description: GNU Midnight Commander cli-based file manager
>       License:     GPL-2
>
> *  app-misc/mc-mp [ Masked ]
>       Latest version available: 4.1.40_pre9
>       Latest version installed: [ Not Installed ]
>       Size of downloaded files: 2,904 kB
>       Homepage:    http://mc.linuxinside.com/cgi-bin/dir.cgi
>       Description: GNU Midnight Commander cli-based file manager. 4.1.x
> branch
>       License:     GPL-2

>From the URL:
"The goal of this project is creating a stable, well-working, usefull
console-only version of well-known Midnight Commander, without bugs
and garbage, like tk, xv and gnome. I'm bored waiting for bugfixes,
and A'rpi's ESP team stops their work in this direction too, so I did
it. I'm fixing all (found) bugs, reported by my friends, and made some
really pleasent new features, like real-time clock, or filegroups
colorizing."

 Basically, this guy is sane, (thank God), and doing what MC really
needs: SIMPLICITY.  I have never bitched at the mc guys, but when I
get to my desk, I am converting to mc-mp.  Cause MC sucks recently.
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-30  1:23     ` Mark Kirkwood
@ 2006-08-30 23:23       ` Mark Kirkwood
  2006-08-30 23:25         ` Justin Piszcz
  0 siblings, 1 reply; 21+ messages in thread
From: Mark Kirkwood @ 2006-08-30 23:23 UTC (permalink / raw
  To: gentoo-user

Mark Kirkwood wrote:
> Ow Mun Heng wrote:
>>
>> I've already updated it to the latest based on the suspend2 version.
>> $uname -r
>> 2.6.17-suspend2-r4
>>
>> $eix xfsprogs
>>      Available versions:  2.7.3 2.7.11 2.8.10
>>      Installed:           2.8.10
>>
>>
>> If not mistaken, the issue, (or barriers if not mistaken) was introduced
>> in the 2.6.17 kernel series.
>> the 2.6.16 series wasn't affected. (I could be wrong, I don't have net
>> access so, I can't verify)
>>
> 
> Right - as it happens I'm doing an update today, so will let you know if 
>   I see any write performance change.
> 


FWIW, I've updated to 2.6.17 and I don't see any change in performance 
at all (215Mb/s reads and 100Mb/s writes).

Now I'm on the standard source tree:

$ uname -r
2.6.17-gentoo-r7

$ eix xfsprogs
      Available versions:  2.7.3 2.7.11 ~2.8.10
      Installed:           2.7.11

which may be a factor.

The other thing I notice is that my filesystems are all under 50%, 
whereas your troublesome one was at 80%or so:

$ df -m
Filesystem           1M-blocks      Used Available Use% Mounted on
/dev/md/2                  529       134       395  26% /
/dev/md/0                  129        10       120   8% /boot
/dev/md/3                 3911        32      3880   1% /tmp
/dev/md/4                 3911       175      3737   5% /var
/dev/md/5                19537      3008     16530  16% /usr
/dev/md/6                19537      2668     16870  14% /home
/dev/md/7               104841     25682     79160  25% /data0

I might try writing a few big files to fill one of 'em up and see if it 
makes any difference!

Cheers

Mark
-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes
  2006-08-30 23:23       ` Mark Kirkwood
@ 2006-08-30 23:25         ` Justin Piszcz
  0 siblings, 0 replies; 21+ messages in thread
From: Justin Piszcz @ 2006-08-30 23:25 UTC (permalink / raw
  To: gentoo-user



On Thu, 31 Aug 2006, Mark Kirkwood wrote:

> Mark Kirkwood wrote:
>> Ow Mun Heng wrote:
>>> 
>>> I've already updated it to the latest based on the suspend2 version.
>>> $uname -r
>>> 2.6.17-suspend2-r4
>>> 
>>> $eix xfsprogs
>>>      Available versions:  2.7.3 2.7.11 2.8.10
>>>      Installed:           2.8.10
>>> 
>>> 
>>> If not mistaken, the issue, (or barriers if not mistaken) was introduced
>>> in the 2.6.17 kernel series.
>>> the 2.6.16 series wasn't affected. (I could be wrong, I don't have net
>>> access so, I can't verify)
>>> 
>> 
>> Right - as it happens I'm doing an update today, so will let you know if 
>> I see any write performance change.
>> 
>
>
> FWIW, I've updated to 2.6.17 and I don't see any change in performance at all 
> (215Mb/s reads and 100Mb/s writes).
>
> Now I'm on the standard source tree:
>
> $ uname -r
> 2.6.17-gentoo-r7
>
> $ eix xfsprogs
>     Available versions:  2.7.3 2.7.11 ~2.8.10
>     Installed:           2.7.11
>
> which may be a factor.
>
> The other thing I notice is that my filesystems are all under 50%, whereas 
> your troublesome one was at 80%or so:
>
> $ df -m
> Filesystem           1M-blocks      Used Available Use% Mounted on
> /dev/md/2                  529       134       395  26% /
> /dev/md/0                  129        10       120   8% /boot
> /dev/md/3                 3911        32      3880   1% /tmp
> /dev/md/4                 3911       175      3737   5% /var
> /dev/md/5                19537      3008     16530  16% /usr
> /dev/md/6                19537      2668     16870  14% /home
> /dev/md/7               104841     25682     79160  25% /data0
>
> I might try writing a few big files to fill one of 'em up and see if it makes 
> any difference!
>
> Cheers
>
> Mark
> -- 
> gentoo-user@gentoo.org mailing list
>

You can also check your fragmentation, xfs_db -c frag /dev/..
and defrag it with xfs_fsir ..

-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

* Re: [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? (SOLVED w/ ReFORMAT)
  2006-08-30 16:38         ` Joshua Schmidlkofer
@ 2006-08-31  3:37           ` Ow Mun Heng
  0 siblings, 0 replies; 21+ messages in thread
From: Ow Mun Heng @ 2006-08-31  3:37 UTC (permalink / raw
  To: gentoo-user

On Wed, 2006-08-30 at 09:38 -0700, Joshua Schmidlkofer wrote:
> On 8/29/06, Ow Mun Heng <Ow.Mun.Heng@wdc.com> wrote:


I just re-formatted my partitions and moved things around. Things are
looking up.
Meaning, I am able to achieve good write/read speeds which is where i
was previously. 15-20MB/s on both writes/reads on btoh nautilus and cp
commands.

So. I'm gonna put it at either.

1. xfs frag
2. xfs dir curruption or something


> Are there
> any good, well optimized file copy utilities for Linux?
> >

Hmm.. interesting

> >
> > *  app-misc/mc
> >       Latest version available: 4.6.1
> >       Size of downloaded files: 11,606 kB
> > *  app-misc/mc-mp [ Masked ]
> >       Latest version available: 4.1.40_pre9

>  Basically, this guy is sane, (thank God), and doing what MC really
> needs: SIMPLICITY.  I have never bitched at the mc guys, but when I
> get to my desk, I am converting to mc-mp.  Cause MC sucks recently.

Well, if I look at the size of the tar, it's 5x difference

-- 
gentoo-user@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 21+ messages in thread

end of thread, other threads:[~2006-08-31  3:42 UTC | newest]

Thread overview: 21+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2006-08-29  4:03 [gentoo-user] XFS FileSystem - Slow Writes Ow Mun Heng
2006-08-29  4:25 ` Jason Weisberger
2006-08-29  6:11 ` Mark Kirkwood
2006-08-29  6:37   ` Ow Mun Heng
2006-08-30  1:23     ` Mark Kirkwood
2006-08-30 23:23       ` Mark Kirkwood
2006-08-30 23:25         ` Justin Piszcz
2006-08-29  9:37 ` Richard Fish
2006-08-29  9:55   ` Mick
2006-08-29  9:58     ` Justin Piszcz
     [not found]   ` <1156845176.2843.24.camel@neuromancer.home.net>
2006-08-29 17:54     ` Richard Fish
2006-08-29 22:10       ` Ow Mun Heng
     [not found]     ` <7573e9640608291055p313ccac8m65a1523b5ad03a37@mail.gmail.com>
2006-08-29 18:03       ` Jeff Grant
2006-08-29 18:13         ` Richard Fish
2006-08-29 18:22           ` Jeff Grant
2006-08-30  1:35     ` Richard Fish
2006-08-30  2:05       ` [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? Ow Mun Heng
2006-08-30 16:38         ` Joshua Schmidlkofer
2006-08-31  3:37           ` [gentoo-user] XFS FileSystem - Slow Writes - GNOME/nautilus Issue? (SOLVED w/ ReFORMAT) Ow Mun Heng
     [not found]       ` <200608300951.58922.michaelkintzios@gmail.com>
2006-08-30  8:52         ` [gentoo-user] XFS FileSystem - Slow Writes Justin Piszcz
2006-08-30  9:27         ` Richard Fish

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox