From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1MbsVQ-00046L-6g for garchives@archives.gentoo.org; Fri, 14 Aug 2009 08:51:24 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 8A703E034D; Fri, 14 Aug 2009 08:51:22 +0000 (UTC) Received: from relay02-haj2.antispameurope.com (relay02-haj2.antispameurope.com [83.246.65.52]) by pigeon.gentoo.org (Postfix) with ESMTP id 3E8DBE034D for ; Fri, 14 Aug 2009 08:51:22 +0000 (UTC) Received: by relay02-haj2.antispameurope.com (ASE-Secure-MTA, from userid 1000) id 4BC476F05B9; Fri, 14 Aug 2009 10:51:20 +0200 (CEST) Received: from pluto.fokus.fraunhofer.de (pluto.fokus.fraunhofer.de [195.37.77.164]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by relay02-haj2.antispameurope.com (ASE-Secure-MTA) with ESMTP id EFB776F0516 for ; Fri, 14 Aug 2009 10:51:19 +0200 (CEST) Received: from EXCHSRV.fokus.fraunhofer.de (bohr.fokus.fraunhofer.de [10.147.9.231]) by pluto.fokus.fraunhofer.de (8.14.2/8.14.2) with SMTP id n7E8pJgr016108 for ; Fri, 14 Aug 2009 10:51:19 +0200 (MEST) Received: from rigel ([10.147.65.195]) by EXCHSRV.fokus.fraunhofer.de with Microsoft SMTPSVC(6.0.3790.3959); Fri, 14 Aug 2009 10:51:19 +0200 Date: Fri, 14 Aug 2009 10:50:45 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Re: [OT] fast recursive local copy Message-ID: <4a852565.lHzcWaqePAPBfdw4%Joerg.Schilling@fokus.fraunhofer.de> References: <20090814024724.GA6759@solfire> In-Reply-To: User-Agent: nail 11.22 3/20/05 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 X-OriginalArrivalTime: 14 Aug 2009 08:51:19.0828 (UTC) FILETIME=[6474B540:01CA1CBC] Content-Transfer-Encoding: quoted-printable X-Archives-Salt: baa35fde-d5ec-485c-adad-2af2bfc6b3af X-Archives-Hash: 8093f29a67e2dd02461ae74e69942d37 Nikos Chantziaras wrote: > On 08/14/2009 05:47 AM, meino.cramer@gmx.de wrote: > > Hi, > > > > I am looking for a faster way to do a > > > > cp -a r > > > > locally on one machine with one harddisk inside. > > > > Is there a neat trick to accomplish this faster than > > good old cp? > > Nope. Some people like to use pipes in hope to speed it up, something = like: > > tar -c | tar -xC > > but this isn't really faster and fscks up sparse files. Pipes definitely do not speed up things, they slow things down as pipes=20 introduce a significant system overhead. The fastest method for copying directory trees (typicalls 30% faster than= any=20 other known method) is to use star: star -copy -p -xdot -acl -sparse -C . Do not forget the '.' !!!!! Note that on Linux you may _need_ to add "-no-fsync" because file I/O is = slow=20 on Linux. On Solaris, not using -no-fsync slows things down by aprox. 10%= but=20 allows star to grant that everything was really copied to stable storage. On Linux, ot using -no-fsync slows things down by aprox. 400%, this is wh= y I recommend to add "-no-fsync". BTW: other programs behave like star=20 "-no-fsync" by default. It may help to speed up things (in case you have enough RAM) to add: fs=3D= 128M Use no more than 1/2 of the physical RAM as FIFO size. Star implements the most effective way since more than 20 years. The idea= is to use a FIFO made of shared memory and to let star fork by default into = two=20 processes that work independently.=20 J=F6rg --=20 EMail:joerg@schily.isdn.cs.tu-berlin.de (home) J=F6rg Schilling D-13353 = Berlin js@cs.tu-berlin.de (uni) =20 joerg.schilling@fokus.fraunhofer.de (work) Blog: http://schily.blo= gspot.com/ URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schil= y