From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 31472 invoked from network); 15 Aug 2004 10:24:12 +0000 Received: from smtp.gentoo.org (156.56.111.197) by lists.gentoo.org with AES256-SHA encrypted SMTP; 15 Aug 2004 10:24:12 +0000 Received: from lists.gentoo.org ([156.56.111.196] helo=parrot.gentoo.org) by smtp.gentoo.org with esmtp (Exim 4.34) id 1BwIBO-0003Qc-N7 for arch-gentoo-portage-dev@lists.gentoo.org; Sun, 15 Aug 2004 10:24:11 +0000 Received: (qmail 26176 invoked by uid 89); 15 Aug 2004 10:24:09 +0000 Mailing-List: contact gentoo-portage-dev-help@gentoo.org; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail Reply-To: gentoo-portage-dev@lists.gentoo.org X-BeenThere: gentoo-portage-dev@gentoo.org Received: (qmail 27699 invoked from network); 15 Aug 2004 10:24:08 +0000 X-OB-Received: from unknown (208.36.123.34) by wfilter.us4.outblaze.com; 15 Aug 2004 10:24:07 -0000 Content-Type: multipart/mixed; boundary="----------=_1092565447-26774-0" Content-Transfer-Encoding: 7bit MIME-Version: 1.0 X-Mailer: MIME-tools 5.41 (Entity 5.404) From: "myfirstname mylastname" To: gentoo-portage-dev@lists.gentoo.org Date: Sun, 15 Aug 2004 05:24:07 -0500 X-Originating-Ip: 80.127.44.35 X-Originating-Server: ws7-5.us4.outblaze.com Message-Id: <20040815102407.EDD0FC610C@ws7-5.us4.outblaze.com> Subject: [gentoo-portage-dev] speedup emerge? X-Archives-Salt: fac5681a-5985-4720-81f3-bdb0babbd73d X-Archives-Hash: 69422ebc80de4efb08b470b594d90383 ------------=_1092565447-26774-0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 7bit Hi there, I installed GENTOO yeserday and I must say: I LIKE IT. Just some observations though: when emerging my way from stage 1 to three, I noticed that the emerge does a lot of stuff serially. It first tries to find out a lot of stuff, then downloads the package, then compiles and then checks. These stages have to wait for each other to complete. Would it be an idea to run these tasks parallelly like: emerge.findout|emerge.download|emerge.build|emerge.check_and_log; the processes could pass an xml job describing structure like : job package file downloaded_ok compiled_ok installed_ok various messages and flags /file /packaeg /job. this way downloading, checking and building are done in parrallel. Extra advantage: the logging process has all relevant status info at hand and can draw intelligent conclusions as to what went wrong. It's just a thought; looking at the emerge script, I couldn's find obvious points for cutting it in four. I noticed that messages are writen to stderr, so piping stdouts to stdins should be no problem. Any thoughts on it? cheers, cobus -- _______________________________________________ Find what you are looking for with the Lycos Yellow Pages http://r.lycos.com/r/yp_emailfooter/http://yellowpages.lycos.com/default.asp?SRC=lycos10 ------------=_1092565447-26774-0 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Return-Path: <> Delivered-To: cobus:lycos.com@mail.lycos.com Received: (qmail 21260 invoked by uid 0); 15 Aug 2004 10:15:04 -0000 X-OB-Received: from unknown (192.168.8.40) by mta7-2.us4.outblaze.com; 15 Aug 2004 10:15:04 -0000 Received: (qmail 16616 invoked by uid 1001); 15 Aug 2004 10:15:04 -0000 X-OB-Delivered-To: cobus:lycos.com@mail.lycos.com X-OB-Received: from unknown (208.36.123.42) by as7-3.us4.outblaze.com; 15 Aug 2004 10:15:04 -0000 X-OB-Received: from unknown (208.36.123.74) by as7-5.us4.outblaze.com; 15 Aug 2004 10:15:04 -0000 Received: from parrot.gentoo.org (lists.gentoo.org [156.56.111.196]) by spf7-14.us4.outblaze.com (Postfix) with ESMTP id 66B6837032 for ; Sun, 15 Aug 2004 10:14:58 +0000 (GMT) Received: (qmail 3540 invoked for bounce); 15 Aug 2004 10:14:54 +0000 Date: 15 Aug 2004 10:14:54 +0000 From: MAILER-DAEMON@parrot.gentoo.org To: cobus@lycos.com Subject: failure notice Message-Id: <20040815101458.66B6837032@spf7-14.us4.outblaze.com> Hi. This is the qmail-send program at parrot.gentoo.org. I'm afraid I wasn't able to deliver your message to the following addresses. This is a permanent error; I've given up. Sorry it didn't work out. : Sorry, only subscribers may post. If you are a subscriber, please forward this message to gentoo-portage-dev-owner@gentoo.org to get your new address included (#5.7.2) --- Below this line is a copy of the message. Return-Path: Received: (qmail 28430 invoked from network); 15 Aug 2004 10:14:54 +0000 Received: from smtp.gentoo.org (156.56.111.197) by lists.gentoo.org with AES256-SHA encrypted SMTP; 15 Aug 2004 10:14:54 +0000 Received: from webmail-outgoing.us4.outblaze.com ([205.158.62.67]) by smtp.gentoo.org with esmtp (Exim 4.34) id 1BwI2P-0006oQ-Vf for gentoo-portage-dev@lists.gentoo.org; Sun, 15 Aug 2004 10:14:54 +0000 Received: from wfilter.us4.outblaze.com (wfilter.us4.outblaze.com [205.158.62.180]) by webmail-outgoing.us4.outblaze.com (Postfix) with QMQP id 9AA8A1800796 for ; Sun, 15 Aug 2004 10:14:53 +0000 (GMT) X-OB-Received: from unknown (208.36.123.34) by wfilter.us4.outblaze.com; 15 Aug 2004 10:14:53 -0000 Received: by ws7-5.us4.outblaze.com (Postfix, from userid 1001) id 88A75C610C; Sun, 15 Aug 2004 10:14:53 +0000 (GMT) Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 7bit MIME-Version: 1.0 X-Mailer: MIME-tools 5.41 (Entity 5.404) Received: from [80.127.44.35] by ws7-5.us4.outblaze.com with http for cobus@lycos.com; Sun, 15 Aug 2004 05:14:53 -0500 From: "myfirstname mylastname" To: gentoo-portage-dev@lists.gentoo.org Date: Sun, 15 Aug 2004 05:14:53 -0500 Subject: emerge speedup? X-Originating-Ip: 80.127.44.35 X-Originating-Server: ws7-5.us4.outblaze.com Message-Id: <20040815101453.88A75C610C@ws7-5.us4.outblaze.com> Hi there, I installed GENTOO yeserday and I must say: I LIKE IT. Just some observations though: when emerging my way from stage 1 to three, I noticed that the emerge script first tries to find out a lot of stuff, then downloads the package, then compiles and then checks. These stages have to wait for each other to complete. Would it be an idea to run these tasks parallelly like: emerge.findout|emerge.download|emerge.build|emerge.check_and_log; the processes could pass an xml struct like : job package file downloaded_ok compiled_ok installed_ok etc /file /packaeg /job. this way downloading, checking and building are done in parrallel. Extra advantage is, that the logging process has all relevant status info at hand and can draw intelligent conclusions as to what went wrong. It's just a thought; looking at the emerge script, I couldn's find obvious points for cutting it in four. I noticed that messages are writen to stderr, so piping stdout to stdin would be no problem. Any thoughts on it? cheers, cobus -- _______________________________________________ Find what you are looking for with the Lycos Yellow Pages http://r.lycos.com/r/yp_emailfooter/http://yellowpages.lycos.com/default.asp?SRC=lycos10 ------------=_1092565447-26774-0 Content-Type: text/plain; charset=us-ascii -- gentoo-portage-dev@gentoo.org mailing list ------------=_1092565447-26774-0--