public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download: 
* Re: [gentoo-dev] Distribuited build
  @ 2002-06-09 21:17 99%   ` Marko Mikulicic
  0 siblings, 0 replies; 1+ results
From: Marko Mikulicic @ 2002-06-09 21:17 UTC (permalink / raw
  To: gentoo-dev

Paul de Vrieze wrote:
> On Sunday 09 June 2002 22:31, Marko Mikulicic wrote
>
> 
> While I didn't test it yet, openmosix could be a solution for better 
> utilization of your computing power. Parallel dependencies are sometimes 
> difficult (cross dependencies), also it would require tweaks to emerge
> 

Well, I delibertely left out openmosix because it is automatically 
supported with make -j n. However there is a big issue with it:
  Openmosix process migration can distribute the load of a single system
through a cluster but if you install n packages they are build in 
sequence so that only compiles from a single build get eventually
distributed. And it's even worst when some packages have parallel build 
disabled.
  Moreover openmosix is not applicable in a etherogeneous network, whith
freebsd, linux, win32, tru64, linux-alpha machines, while distcc can
execute cross-compilers on every architecture (windows too).
  and openmosix requires all to run a special kernel, administrative 
issues,.... I think that something lighter is needed, for it to be
really useful. I have access to a LAN with 16 PIV 1.5Gh but with any 
kindof linux distros, versions, libraries, users. The only 
administrative power I have is to run niced jobs and a good amount of
ram.

  However the problem is not openmosix vs. distcc, while both are 
completely transparent with portage and both have the same problem:
  sequential builds.

As for cross dependencies, how does portage handle the now? There could
a queue for each pending build where dependent build are added.
RDEPEND does not conflict with paralell builds.
  I agree this would require tweaks to emerge. I think it's not
urgent in portage1, but it could go in portage2, which with it's added
performance could resolve this kind of dependence in acceptable time.
  What do you think ?

Marko



^ permalink raw reply	[relevance 99%]

Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2002-06-09 20:31     [gentoo-dev] Distribuited build Marko Mikulicic
2002-06-09 14:38     ` Paul de Vrieze
2002-06-09 21:17 99%   ` Marko Mikulicic

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox