From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id D7656139694 for ; Thu, 27 Apr 2017 14:14:46 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 33D9721C090; Thu, 27 Apr 2017 14:14:34 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id DCE0CE0DBE for ; Thu, 27 Apr 2017 14:14:33 +0000 (UTC) Received: from pomiot (d202-252.icpnet.pl [109.173.202.252]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: mgorny) by smtp.gentoo.org (Postfix) with ESMTPSA id E85153416CD; Thu, 27 Apr 2017 14:14:31 +0000 (UTC) Message-ID: <1493302453.1189.1.camel@gentoo.org> Subject: [gentoo-dev] [RFC] Providing consistent means to enable tests requiring Internet access From: =?UTF-8?Q?Micha=C5=82_G=C3=B3rny?= To: gentoo-dev Cc: qa Date: Thu, 27 Apr 2017 16:14:13 +0200 Organization: Gentoo Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-C5RseoMv2u51F/txAZx/" X-Mailer: Evolution 3.22.6 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org Mime-Version: 1.0 X-Archives-Salt: dcd7f721-765e-4ce5-8328-644f31a1e38a X-Archives-Hash: eee195c19309f45e81aef6f665239345 --=-C5RseoMv2u51F/txAZx/ Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, everyone. Per long-standing unwritten (or rather, written but not really officially approved) policy unmasked ebuilds are not allowed to fiddle with Internet. While this normally makes a lot of sense (except for special cases like live ebuilds), this also means that for some poorly written packages we end up either disabling a fair number of tests, or even restricting tests completely. The Internet-based tests are of course mostly unreliable in the long run, and should normally be replaced by some kind of mocking, local servers etc., we simply do not have the manpower to fix all the packages. All we can do is disable them. Sadly, for some packages this means that we're left with no tests at all. As developers, we can play around to run the tests manually, or comment out needed ebuild bits for extra local testing. However, I think it would make our work easier if we had a more uniform solutions for detecting whenever the developer needs to disable networked tests, and how to enable them. The obvious solution would be to use a global USE flag with explanatory description for that. For example: internet-test - Enable running tests that access the Internet. Those tests can be unreliable, result in data transfer fees and cause privacy concerns (potentially exposing which packages are being installed). Use at your own discretion. The advantages of that would be: a. tests requiring Internet are exposed in the standard ebuild metadata, making it easy to grab it using standard tools, b. those tests can easily be enabled, and that fact is recorded in the installed package metadata, c. the flag can easily be used in RESTRICT=3D"" constraint to easily disable all the tests. The disadvantage is that we're introducing yet another special flag that does not affect installed files. What do you think? Any other ideas? --=20 Best regards, Micha=C5=82 G=C3=B3rny --=-C5RseoMv2u51F/txAZx/ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQKTBAABCgB9FiEEXr8g+Zb7PCLMb8pAur8dX/jIEQoFAlkB/LZfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDVF QkYyMEY5OTZGQjNDMjJDQzZGQ0E0MEJBQkYxRDVGRjhDODExMEEACgkQur8dX/jI EQqCew//ZyYdD0DR9MvJzB5fMWImDfcxtqGJVedzyMnkJl8iKhMjnj9z++V0efox z3dVbZBhCmuAnLu+gjaLuTxc8AlrJ5LjbB82BLM6eEZQpOwavZOTctLVlYaLBI4d /x3W6I3IWPnpBf+BxilQEgCGeal248NjQbsDfwwMMHRdEGMVMzaittJUhRbDJXjq PL/3CO5gAM414hONrcDWJZeTN+TXWTlDnKTFa+CW97/vGwA62r/pB91t4l73J3+K wCVSsvS1zAtrtZoztAcriFn35h2h1Ln8ZbRZDfFh6W1wDzG82/Zbt5uFQ34gbK1p f+I57qvr9qmkJsEKZQuKejesr4vLBqKcPLeY5moyhUpHDa8dU2ioMojS4XhP0+I8 1nNdQI43PCHs129irfEA9jU0IcgmxmBhRX3MpLH7XpZTqphzkbRYw4mO6A1lpjzq JAlbBquQABgImvvYe2mfMdSLYOTvbR/jj8UgqeQ2a8GsfySgVMMk2IJU8LLQx+3J Y7u2yyQiayG+epWKLqCrVA0Wp9MBl/YVTWEFytwXINt/xbb/vAzawXaE3s0BDicd 5M0WQApIPOs0xIhfE0LTJwbCVVJyS4i7vgKja4uTnTTSWLeuw3zfbQ5UE5SmupDL NPNNjkS/Hv1zRKha40Su/y8HSGKFcID48KP5NIa8pkq44bwEYqs= =jHlU -----END PGP SIGNATURE----- --=-C5RseoMv2u51F/txAZx/--