From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1QexDt-0004Ux-W5 for garchives@archives.gentoo.org; Thu, 07 Jul 2011 22:39:06 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 4196221C111; Thu, 7 Jul 2011 22:38:10 +0000 (UTC) Received: from mail-gx0-f181.google.com (mail-gx0-f181.google.com [209.85.161.181]) by pigeon.gentoo.org (Postfix) with ESMTP id 14BFC21C111 for ; Thu, 7 Jul 2011 22:38:09 +0000 (UTC) Received: by gxk9 with SMTP id 9so793202gxk.40 for ; Thu, 07 Jul 2011 15:38:09 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-soc@lists.gentoo.org Reply-to: gentoo-soc@lists.gentoo.org MIME-Version: 1.0 Received: by 10.150.237.17 with SMTP id k17mr1491176ybh.195.1310078289402; Thu, 07 Jul 2011 15:38:09 -0700 (PDT) Received: by 10.151.99.7 with HTTP; Thu, 7 Jul 2011 15:38:09 -0700 (PDT) Date: Thu, 7 Jul 2011 23:38:09 +0100 Message-ID: Subject: [gentoo-soc] Gentoaster - Week 3/4/5/6 rollup progress report From: Liam McLoughlin To: gentoo-soc@lists.gentoo.org Content-Type: text/plain; charset=ISO-8859-1 X-Archives-Salt: X-Archives-Hash: 172c6326b11095a8e401713206d698f5 Hey, I know I've not done one of these in several weeks, I've not had much progress due to exams and a week out of the country. However, I'm now back and going full steam ahead until the end of GSoC on this project and currently ahead of schedule. I'm just going to rollup all the changes I've made since I last reported into this report. Here's a rundown of what I've been doing in the past four weeks: - Moved Stage3 and Portage snapshot downloads over to my own server and fixed the logic for downloading/extracting these - Added configuration file loading, you can now create an INI form config to define how the VM should be built (here's an example of how these work: http://pastebin.com/XyjrrAQx) - Added an option to use a prebuilt kernel and modules to speed up the build (using this a lot during testing runs, reduces minimal image build time to around 1 minute on a MBP) - Added package.use/package.accept_keywords configuration support - Added custom package list configuration support so you can add anything to your VM from the config - Created system for allowing for different output formats, currently raw, VMWare and VirtualBox disk formats are supported - Included some example configurations So at this point, the VM build tool is pretty much done. I'm now moving on to the build daemon. For this, I'm using a project my mentor suggested, Gearman. This should make the queueing and dispatching of build processes a cinch. So here's the plan for this week: - Improve isolation on the VM build tool, chroot jail each build process - Setup Gearman on my development machine - Build Gearman worker - Build Gearman client - Test both of these together with the example configurations and make sure they work as expected The amount of time I expect the daemon to take has reduced significantly from that I planned in my original proposal due to the use of Gearman, and so I expect to finish rather earlier than planned. The daemon should be finished by next week, and then I'll move onto the WebUI which I expect to take a few weeks. Once a work in progress version of that is ready to show, I'll see if I can setup a copy you can use to try it out. It'll probably be missing polish and features, but it should allow you to try out Gentoaster without downloading anything. I'll need to find hardware to run that, but I think I might be able to source a beefy server for it for public use. Cheers, Liam