From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 6E42F1381F3 for ; Thu, 2 May 2013 05:03:34 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 6E2D6E0A43; Thu, 2 May 2013 05:03:22 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 6DB75E0969 for ; Thu, 2 May 2013 05:03:21 +0000 (UTC) Received: from [172.16.6.30] (173-13-138-133-sfba.hfc.comcastbusiness.net [173.13.138.133]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: zerochaos) by smtp.gentoo.org (Postfix) with ESMTPSA id 3E2E833E01C for ; Thu, 2 May 2013 05:03:20 +0000 (UTC) Message-ID: <5181F44A.5050204@gentoo.org> Date: Thu, 02 May 2013 01:06:18 -0400 From: "Rick \"Zero_Chaos\" Farina" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130406 Thunderbird/17.0.5 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 To: gentoo-dev@lists.gentoo.org Subject: Re: [gentoo-dev] Re: Handling of tests References: <20130430212540.2a6d97ab@caribou.gateway.2wire.net> <20130501101402.20d4bf62@sera-20.lan> <20130501191852.75fadabc@caribou.gateway.2wire.net> In-Reply-To: <20130501191852.75fadabc@caribou.gateway.2wire.net> X-Enigmail-Version: 1.6a1pre Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Archives-Salt: 78ea7294-4b17-4600-b17f-3750385d5b96 X-Archives-Hash: 7af7c5c0940d05e1c4d6deddbae78be6 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 05/01/2013 09:18 PM, Ryan Hill wrote: > On Wed, 1 May 2013 10:14:02 +0200 > Ralph Sennhauser wrote: > >> On Tue, 30 Apr 2013 21:25:40 -0600 >> Ryan Hill wrote: >> >>> I'm also going to rename the "test" flag to "regression-test" or >>> something similar to get it out of FEATURES="test" control. The >>> testsuite is a huge time-suck and only useful to developers IMO >>> (always expected to fail and primarily meant to be used to check for >>> regressions between patchsets). I'm a big supporter of >>> FEATURES="test" by default and I think this is a small step towards >>> that. >> >> This step is so tiny that we wont ever reach the goal like this. > > I was hoping it would set a precedent and then people would start thinking of > splitting up test into categories, maybe even start a thread about it ;). > >> Let's >> start to properly classify test into categories, like for instance >> >> - expected to be run (cheap, no silly deps) >> - good thing if run (still reasonable wrt resources) (current src_test) >> - if you are the maintainer or simply curious. (boost, jtreg and >> friends) > > Something like "dev-test" or "qa-test"? I can think of a couple packages.. > >> ... and improve on how to configure Portage whether to run tests of any >> given category. > > Yeah I'd love to be able to do something like emerge TESTS="dev qa > system -extradeps -expensive" @world. Honestly, IMHO, I think breaking it down to more than "test" and "qa" is excessive. I certainly wouldn't block anyone that wishes to do that work, but I think we all realize that enabling tests (and especially some of the really awesome QA tests Diego does in the tinderbox) are really expensive time wise. The average user should never have this enabled, and honestly, most devs shouldn't have it enabled either as they simply won't have the hardware to run the tests every time (I know I've commited things from my chromebook without excessive testing...). I have a little cron script that builds all the packages I'm marked maintainer of every night with FEATURES=test and would be easy enough to adapt to looking at herd instead of maintainer. I don't claim to be the expert on testing, but in case anyone finds something like this useful... here: #!/bin/sh emerge --sync -q #maintainer check (excluding madwifi) MAINTAINER_OF="$(fgrep 'zerochaos@gentoo.org' /usr/portage/*/*/metadata.xml | cut -d/ -f4-5 | grep -v madwifi)" #build test FEATURES="test" emerge --deep --oneshot -q ${MAINTAINER_OF} if [ $? -ne 0 ]; then echo "build failed, see above" fi #repoman check for atom in ${MAINTAINER_OF}; do cd /usr/portage/${atom} repoman -qd full > /dev/null if [ $? -ne 0 ]; then repoman -qd full fi done Thanks, Zero PS> I welcome suggestions for this script, new functionality is always welcome -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJRgfRKAAoJEKXdFCfdEflKJPYP/2qUMB5T3KZ1jT2dusdgg3KA yuPAc6xL9VNg25pnVYl14JoS66z1hKpisSCCZeeGT7uqRDEkh+jseEaZIOhrektb Zgn3WXmekmU5pc9wicUW4aYVzNyc9PBbw2NcBWq1HwgfMcwBoX87FxVECw0L71dO hNOWQbJ1amGGoLXiMmAI/S4CpkZcfX3WZv0R2oosKK/Iu34gZeHGk2w5ui4tuY6g sZmKawjXTFzbluIcaZlUPyajBjyZEXx0Vsp3uYUY1lStUNG45q5jaz3/83V+NkF2 Lu0FHrXrSW97f19k2HkcTdl4icF48k6bmIbw22xZ1lII+rnV/3uqsok/UayRyF1c w6EIFnS37M/MhDknJ9R65P18v/SWAP2MLnfhcIqFDWs6jXZqq8vpBOfW+waEWsKK 8qflxpU08joUBsUSBcz+Y8s6JBxbWVdlY+f+jLsP6kPUH5otHKym7vB2P0nqCGQQ SayT8fpK5izX4UraNhpuOiDV8nH7cvD1h3t6MRlSzRshj7UWyw4nYIkhqFZJhFzW g6hfmLUGqHeHxRKMyImVLY4+PST820s+5mTTG57YuXmzD/nYU9N2Yor61FtgLR26 975mApTT4cunHdiUudyGbeaE0j0f/wOe1CAivzTCmDi+tM4dYR78XscPRZCsrk2+ JeNw6XtA5A6jvVk12jYN =+Zzv -----END PGP SIGNATURE-----