From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <gentoo-user+bounces-160405-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
	by finch.gentoo.org (Postfix) with ESMTP id ED64D1389E2
	for <garchives@archives.gentoo.org>; Thu,  4 Dec 2014 21:08:21 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
	by pigeon.gentoo.org (Postfix) with SMTP id 50DF2E0952;
	Thu,  4 Dec 2014 21:08:17 +0000 (UTC)
Received: from mail-ie0-f172.google.com (mail-ie0-f172.google.com [209.85.223.172])
	(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
	(No client certificate requested)
	by pigeon.gentoo.org (Postfix) with ESMTPS id 43B8BE0884
	for <gentoo-user@lists.gentoo.org>; Thu,  4 Dec 2014 21:08:16 +0000 (UTC)
Received: by mail-ie0-f172.google.com with SMTP id tr6so16624427ieb.31
        for <gentoo-user@lists.gentoo.org>; Thu, 04 Dec 2014 13:08:15 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:sender:in-reply-to:references:date:message-id:subject
         :from:to:content-type;
        bh=JdE5QuRn1sPMPSOuaI2Pwi2qONyblSDLtWPtYbL34p0=;
        b=x84P3+VSbi41tKwDH6VL8TEEcPh2yxtRX/FVNKuo7OzF3ctR7cWdinJjvy7U5bsjnR
         xKf3Y9jVcGnEBqfObdiaiZUZym+83pMWqXHJls8IFItOdsdCsotKFByNo36/AvzDkof2
         ZTwo7uMlNmDiZ/nntDws9fFjWFB8xt+KlJnZHPCudJDGDKv56CYLgb1g9OvQk/zwmBSp
         rBljLAWbGwYlWF88RITXFOsbpDYLKv4GsXXLbt0U4bR/d1UKOq7SDXmXPsETDQP0GjzO
         qSjgINzvneCcw888mVeO1+1HUCSz3g5tZOEgu9b5GAz2MXWDCagcwp/UV55hFhmst7e+
         jceQ==
Precedence: bulk
List-Post: <mailto:gentoo-user@lists.gentoo.org>
List-Help: <mailto:gentoo-user+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-user+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-user+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-user.gentoo.org>
X-BeenThere: gentoo-user@lists.gentoo.org
Reply-to: gentoo-user@lists.gentoo.org
MIME-Version: 1.0
X-Received: by 10.107.12.234 with SMTP id 103mr11875290iom.71.1417727295513;
 Thu, 04 Dec 2014 13:08:15 -0800 (PST)
Sender: freemanrich@gmail.com
Received: by 10.107.9.80 with HTTP; Thu, 4 Dec 2014 13:08:15 -0800 (PST)
In-Reply-To: <5480B7A8.5030204@alectenharmsel.com>
References: <loom.20141201T175046-420@post.gmane.org>
	<3306609.71mJRjCGqA@elijah>
	<5480B7A8.5030204@alectenharmsel.com>
Date: Thu, 4 Dec 2014 16:08:15 -0500
X-Google-Sender-Auth: 3IaB90EcJv6r-uWeqvBaReuP1PY
Message-ID: <CAGfcS_=FjsWFjPEtuoAt_LBJyNskJaV3ozVbVb1sa_8-hDJzJQ@mail.gmail.com>
Subject: Re: [gentoo-user] automated code validation
From: Rich Freeman <rich0@gentoo.org>
To: gentoo-user@lists.gentoo.org
Content-Type: text/plain; charset=UTF-8
X-Archives-Salt: e1e42c3f-4cbf-41cb-a145-366b8cd713a5
X-Archives-Hash: eda249e0fc46f60eb076b5b5b8bcb7d3

On Thu, Dec 4, 2014 at 2:36 PM, Alec Ten Harmsel
<alec@alectenharmsel.com> wrote:
>
> It'd be cool if Gentoo had some sort of automated workflow (with
> Jenkins, buildbot, whatever) like this:
>
> 1. Receive pull request
> 2. Detect changed ebuild
> 3. test ebuild with etest
>
> This will take a lot of work to set up, and depending on how my workload
> is next semester, I would love to help out as much as possible.
>

I've wondered the same thing, and maybe after sufficient bikeshedding
something like this would be a good GSoC project as well.  Running
repoman is another possibility.

One trick is that a pull request could impact multiple packages
(eclass changes, dependency updates, etc).  In these cases running
repoman probably adds more value than full tests.  Either way there
will potentially be a high cost to do the testing, which could create
a backlog if we queue things up (not queuing things creates other
problems).  Repoman false-alarms is another potential issue with this.

So, it may not be a trivial thing to do, but some kind of CI workflow
would be a wonderful thing to have.

--
Rich