From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id F1F64139694 for ; Tue, 25 Jul 2017 13:51:19 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 370211FC070; Tue, 25 Jul 2017 13:51:15 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id D8F1F1FC007 for ; Tue, 25 Jul 2017 13:51:14 +0000 (UTC) Received: from pomiot (d202-252.icpnet.pl [109.173.202.252]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: mgorny) by smtp.gentoo.org (Postfix) with ESMTPSA id 541363417CA; Tue, 25 Jul 2017 13:51:13 +0000 (UTC) Message-ID: <1500990669.795.14.camel@gentoo.org> Subject: Re: [gentoo-dev] Re: [RFC] Future of gentoo's stable and unstable trees: what are your thoughts? From: =?UTF-8?Q?Micha=C5=82_G=C3=B3rny?= To: gentoo-dev@lists.gentoo.org Date: Tue, 25 Jul 2017 15:51:09 +0200 In-Reply-To: <40c383ef-83ad-20bc-7d9c-dcb74b589a26@gentoo.org> References: <20170724222223.6d359e47@sf> <40c383ef-83ad-20bc-7d9c-dcb74b589a26@gentoo.org> Organization: Gentoo Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-W/uHV8VRp1f3P1McyREl" X-Mailer: Evolution 3.22.6 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org Mime-Version: 1.0 X-Archives-Salt: 163bbb16-9587-407c-96a1-fb370fff077b X-Archives-Hash: f4e3b351a7209e1728d1e1c43ef6ef7a --=-W/uHV8VRp1f3P1McyREl Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On wto, 2017-07-25 at 22:59 +1000, Michael Palimaka wrote: > On 07/25/2017 07:22 AM, Sergei Trofimovich wrote: > > 2. Q: How to make arch testing faster and easier? > >=20 > > A: - KEYWORDREQ/STABLEREQ bugs not marked as "runtime testing > > required" will be automatically tested and keyworded. > >=20 > > [handwave] automated tinderbox setup would help a lot > > to now upfront what fails to built, fails tests. >=20 > I've had similar thoughts about this and have already been working on > some tooling for this. >=20 > We would need to establish exactly what criteria must be met for an > automated test to be considered as successful. >=20 > Here's a sample report that my tool produces: > https://dev.gentoo.org/~kensington/tinderbox/sys-apps/dbus/dbus-1.6.18-r1= /df017e14-bd68-47e2-9738-554e7ba1cf10.html >=20 > In this case, would it be enough that it builds and tests pass? What > about the QA issues? Do we need someone to review them to determine if > they should block stabilisation, or if they're even a regression or not? >=20 There are different kinds of QA issues and they have different significance. You can ignore some of them, some others are more important. GLEP 65 defines a 'eqatag' function that the checks can use to provide machine-readable results for the checks. You should work with that instead of parsing the verbose messages. --=20 Best regards, Micha=C5=82 G=C3=B3rny --=-W/uHV8VRp1f3P1McyREl Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQKmBAABCgCQFiEEbbsHzE8NrQbqCv5BsHoa6u+0Rk4FAll3TM1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDZE QkIwN0NDNEYwREFEMDZFQTBBRkU0MUIwN0ExQUVBRUZCNDQ2NEUSHG1nb3JueUBn ZW50b28ub3JnAAoJELB6GurvtEZOMDgQALrQf/2hBbrC9OFbs4vpQiqdIsy+byPR TGy/O/UiNj9vPj5qjVRuMiqoHiKisvgmkMJ9LErUDTyN73B/VifKuOOf/Fy892f6 XZKe9CO7euS108s0lJ0vU4GGfT5vjJUDOEF32D6MpD/eqkug0JPuYEa0igpSxE4L xiHbG3HvYdtRsHmGAoGdSYVyA+5jg1xrLXfQgqUJBnor3J9Zlvsgw8+b6KcY6lx0 w/bhhpc5V0Z2Xm/73M6F5rii96ZIt97mY0sQVu6xt99RFD5JznFMIj73eLz+CmWe MrHReV4IFBKILBJXaW17g/FWe/HaRHoaDTv8MrINoyrbq1H1KrHVS3/6qewqyNF8 0YQqvnC8AFa2+2yEYGC866iY4iqUpZmk9r+1u59dT/9cQZFaFqycN5/T/re2bgWH J5C8K4VcGcNHkrFaoCBAFBFzoBoaS7hCLpddsdRStHIC01jMm2Whi/w8tVmA6FLs t3NBXEXMp/ZGoh0uS8gYQiU2e9NnqtzF26qqq0gVAZChb2zAQWoGM2W8rNTKqCAn vxIx+6VelIjnooz7jStFjvrkLlo0O9S0M4koPmp543hAR7bfSUhpGUQIsyjpwsbx 6DrP7kwT17NeJPjrv58EiF2vY/3gyHL4WwEmICtdspWQn+h9zR6tMnh1h6SBnPGE jQFKIGyUH7WZ =9kBR -----END PGP SIGNATURE----- --=-W/uHV8VRp1f3P1McyREl--