From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 0DB15138262 for ; Tue, 17 May 2016 11:43:01 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 308C922418B; Tue, 17 May 2016 11:42:53 +0000 (UTC) Received: from mail-io0-f196.google.com (mail-io0-f196.google.com [209.85.223.196]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 54116224052 for ; Tue, 17 May 2016 11:42:52 +0000 (UTC) Received: by mail-io0-f196.google.com with SMTP id i75so2836596ioa.2 for ; Tue, 17 May 2016 04:42:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to; bh=FsM05cMV154vAhdADiTXQJm/vUiFtYT1XBE0w8vDxww=; b=bXpdnz+cDvZXvHTr/XnZnfHWIj64HrGwuGsADdSthOoyiqboBr5s6oO6ZW2lo4PMeb zZ2sCHwa/BZKlHhsTYg91jM+si5Sa2/YIr1iuvW8vxowV0XCP6surkEUhgyP9xxf05DB nJvYjB9/gvnb0Oor/vAQi9NQFGdVPypZhNsPuP40A4TCk6gTp8+3fvbjfKvT/Jb7jcjt VvqjKRhsIPPqUVfzXzq108qZaGvlzUPXLfA5nj5F5nCmYi/T4yY4u4gK672f8bFkQ0rj kKrsRZtsrAUBREhlgs24RWssVqh8AH+EIRvr3tFuQBU9KB8je9ibhkrja+nP+D9YnMl3 QeAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to; bh=FsM05cMV154vAhdADiTXQJm/vUiFtYT1XBE0w8vDxww=; b=kQ855WJfmbh6PCuaMDQZLqTrUxqtTnCXezIbReTpzNjo6HXs3wItDI1VoqmBdFDb3G tvnX5sgxAbItW7RYOWuQOQefUNvUcwYZEe+9X0nwwInoB7YckVxHNDeuYj5VDajN2hh8 OF+4EpdlE/j5pBS3JwjT3GlnmrYZ76YoyGGokMmy8osXzU8gd7fY1P5lNmpFF6d123Oa DfJA468DH3kZM9JYvvVW6trVXA5PbofJZnD36wmd1/jrUneCZuOKH14106Hg0MupHPSs K2OA30i0kqYd4b92yZw9WYJ4kJc4W2ECSFJ1Tx3+zAjad+CR7s04REnWQZJBFXu/tPQd 2YbQ== X-Gm-Message-State: AOPr4FWyoVQslvDAWXpslNA9miXcthoawjS/L2Y+TYKEInP2XCuTIzsimM4ATXee6ivEOqDeiUWAuxZDiUPXoA== Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 X-Received: by 10.107.184.10 with SMTP id i10mr567250iof.26.1463485371566; Tue, 17 May 2016 04:42:51 -0700 (PDT) Sender: freemanrich@gmail.com Received: by 10.64.159.8 with HTTP; Tue, 17 May 2016 04:42:51 -0700 (PDT) In-Reply-To: References: <20160516183840.4b241463@gentp.lnet> <20160517084643.GA24972@skade.schwarzvogel.de> Date: Tue, 17 May 2016 07:42:51 -0400 X-Google-Sender-Auth: ERlOsMK5Oi9s0WjY4NETj_y0EYU Message-ID: Subject: Re: [gentoo-dev] Proposal for changes for the next EAPI version From: Rich Freeman To: gentoo-dev Content-Type: text/plain; charset=UTF-8 X-Archives-Salt: dd29f703-3eb7-42d1-882a-df1a4290863c X-Archives-Hash: 955a32bf5204b501c776874c34a47baf On Tue, May 17, 2016 at 7:25 AM, Pallav Agarwal wrote: > Because we are already expecting an arch tester to conduct tests for the > package. And knowing what to test is something I expect to come more > easily from the maintainer. > It would come even more easily from upstream. My point is that upstream obviously doesn't consider it a priority, since if they did they'd be already supplying automated build scripts and we'd already be using them in the test phase. Maintainers generally don't consider them a priority either, since I imagine many existing upstream build scripts aren't implemented, and when they don't exist maintainers generally do not provide test plans. Again, I'm not objecting to the creation of this feature. I just think that it is unlikely to have a large impact on how things get done except perhaps for a couple packages or projects. For those packages/projects that do adopt this I'm sure there will be some real benefits. I'd also suggest having some way to break out short vs long tests. It might be beneficial to users to be able to run the tests on their own systems and not just limit this to arch testing. Obviously users are going to be less likely to want to run test scripts that take hours to run. Due to the nature of Gentoo it is unlikely that the environment used for testing by the AT is identical to the environment the packages will be run in. I'm not negating the value of testing prior to stabilization, but I don't agree that it completely takes the place of testing at time of installation and if we have automated test scripts, why not make them available to users? Of course, that would suggest that there is a potential benefit to be had from putting this into an EAPI. My suggestion would be to try to design this so that it would be appropriate for a future EAPI, but defer considering it for an EAPI until we see the feature getting enough use/demand to warrant this. -- Rich