public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download: 
* Re: [gentoo-dev] Distribuited build
  @ 2002-06-09 21:49 99%     ` Nick Jones
  0 siblings, 0 replies; 1+ results
From: Nick Jones @ 2002-06-09 21:49 UTC (permalink / raw
  To: gentoo-dev

OpenMosix is not a viable option for compiling with "make -j".
The threads of a source file building do not exist long enough
to be migrated. I tired it... Didn't do very well.

> Paul de Vrieze wrote:
> > On Sunday 09 June 2002 22:31, Marko Mikulicic wrote
> >
> > 
> > While I didn't test it yet, openmosix could be a solution for better 
> > utilization of your computing power. Parallel dependencies are sometimes 
> > difficult (cross dependencies), also it would require tweaks to emerge
> > 
> 
> Well, I delibertely left out openmosix because it is automatically 
> supported with make -j n. However there is a big issue with it:
>   Openmosix process migration can distribute the load of a single system
> through a cluster but if you install n packages they are build in 
> sequence so that only compiles from a single build get eventually
> distributed. And it's even worst when some packages have parallel build 
> disabled.
>   Moreover openmosix is not applicable in a etherogeneous network, whith
> freebsd, linux, win32, tru64, linux-alpha machines, while distcc can
> execute cross-compilers on every architecture (windows too).
>   and openmosix requires all to run a special kernel, administrative 
> issues,.... I think that something lighter is needed, for it to be
> really useful. I have access to a LAN with 16 PIV 1.5Gh but with any 
> kindof linux distros, versions, libraries, users. The only 
> administrative power I have is to run niced jobs and a good amount of
> ram.
> 
>   However the problem is not openmosix vs. distcc, while both are 
> completely transparent with portage and both have the same problem:
>   sequential builds.
> 
> As for cross dependencies, how does portage handle the now? There could
> a queue for each pending build where dependent build are added.
> RDEPEND does not conflict with paralell builds.
>   I agree this would require tweaks to emerge. I think it's not
> urgent in portage1, but it could go in portage2, which with it's added
> performance could resolve this kind of dependence in acceptable time.
>   What do you think ?
> 
> Marko


^ permalink raw reply	[relevance 99%]

Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2002-06-09 20:31     [gentoo-dev] Distribuited build Marko Mikulicic
2002-06-09 14:38     ` Paul de Vrieze
2002-06-09 21:17       ` Marko Mikulicic
2002-06-09 21:49 99%     ` Nick Jones

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox