From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 8B12D138359 for ; Sat, 7 Nov 2020 11:30:12 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 3F433E07F9; Sat, 7 Nov 2020 11:30:09 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id CF167E07D7 for ; Sat, 7 Nov 2020 11:30:08 +0000 (UTC) From: Agostino Sarubbo To: gentoo-dev@lists.gentoo.org Cc: soap@gentoo.org Subject: Re: [gentoo-dev] A feedback about the CI bug reporting system Date: Sat, 07 Nov 2020 12:30:00 +0100 Message-ID: <2675892.Y6S9NjorxK@spectre> In-Reply-To: <2044703.irdbgypaU6@spectre> References: <2044703.irdbgypaU6@spectre> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1" X-Archives-Salt: b94cc1bb-a7d8-4845-9125-03f7e1bb4124 X-Archives-Hash: 56816b9dae90b2ecdd50fa7eb08eda66 On venerd=EC 6 novembre 2020 08:21:39 CET Agostino Sarubbo wrote: > Hello all, >=20 > 6 months have been passed after the CI system started to file bug reports. > ~ 4700 bugs have been submitted >=20 > We _know_ that atm is not possible to set a specific summary, instead a > generic summary is used in case of compile failures and test failures. > There are also some documented limitations. >=20 > If there aren't much commits, usually you get the bug after 30 minutes af= ter > the commit and this looks to be nice. >=20 > Since there are conflicting opinions I would like to know if you find it > useful or not. >=20 > More info about the project here: > https://blogs.gentoo.org/ago/2020/07/04/gentoo-tinderbox/ >=20 > Please keep me CC'ed >=20 > Thank you > Agostino Thanks all for the feedback. What looks strange is that ci/tinderbox opened ~4700 bugs, sure, there are= =20 invalid/duplicate bugs but the majority are fixed so in my opinion they wer= e=20 useful, but looking at the mailing list feedback looks to be a completely=20 crap. I want to play the game of destructive people but in a constructive way. Thanks to @gyakovlev for the idea I have opened a new github project where = we=20 can collect the requests and the bugs: https://github.com/asarubbo/ci/issues An important note: I consider this 'project' as something related to QA ( if you have a differ= ent=20 opinion feel free to say ), so since I received rant from developers for=20 something requested by other developers, I will touch the code ONLY when th= ere=20 is the QA lead approval. When you want a new feature or you want to modify something that already=20 exists, please open a thread (gentoo-dev is fine, and thanks to bman for th= e=20 tracking idea) and open a github issue only when there is a written track o= f=20 the QA lead approval mentioned above. There is a README into the repository that explains all class of bugs=20 discovered by the CI system. Thank you Agostino