From: Oskari Pirhonen <xxc3ncoredxx@gmail.com>
To: "Robin H. Johnson" <robbat2@gentoo.org>
Cc: gentoo-dev@lists.gentoo.org
Subject: Re: [gentoo-dev] RFC: banning "AI"-backed (LLM/GPT/whatever) contributions to Gentoo
Date: Wed, 6 Mar 2024 00:53:47 -0600 [thread overview]
Message-ID: <ZegS-2AF-469KWES@dj3ntoo> (raw)
In-Reply-To: <robbat2-20240305T050858-871585605Z@orbis-terrarum.net>
[-- Attachment #1: Type: text/plain, Size: 1959 bytes --]
On Tue, Mar 05, 2024 at 06:12:06 +0000, Robin H. Johnson wrote:
> At the top, I noted that it will be possible in future for AI generation
> to be used in a good, safe way, and we should provide some signals to
> the researchers behind the AI industry on this matter.
>
> What should it have?
> - The output has correct license & copyright attributions for portions that are copyrightable.
> - The output explicitly disclaims copyright for uncopyrightable portions
> (yes, this is a higher bar than we set for humans today).
> - The output is provably correct (QA checks, actually running tests etc)
> - The output is free of non-functional/nonsense garbage.
> - The output is free of hallucinations (aka don't invent dependencies that don't exist).
>
> Can you please contribute other requirements that you feel "good" AI output should have?
>
- The output is not overly clever even if correct.
It should resemble something a reasonable human might write. For
example, some contrived sequence of Bash parameter expansions vs using
sed.
- The output is succinct enough.
This continues the "reasonable human" theme from above. For example, it
should not first increment some value by 4, then 3, then 2, and finaly 1
when incrementing by 10 right off the bat makes more sense.
- The output domain is able to be restricted in some form.
Given a problem, some things are simply outside of the space of valid
answers. For example,
sudo rm -rf --no-preserve-root /
should not be a line that can be generated in the context of ebuilds.
- Simply enumerating restrictions should be considered intractable.
While it may be trivial to create a list of forbidden words in the
context of a basic family-friendly environment, how can you effectively
guard against forbidden constructs when you might not know them all
beforehand? For example, how do you define what constitutes "malicious
output"?
- Oskari
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 228 bytes --]
next prev parent reply other threads:[~2024-03-06 6:54 UTC|newest]
Thread overview: 39+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-02-27 14:45 [gentoo-dev] RFC: banning "AI"-backed (LLM/GPT/whatever) contributions to Gentoo Michał Górny
2024-02-27 15:10 ` Arsen Arsenović
2024-02-27 15:21 ` Kenton Groombridge
2024-02-27 15:31 ` Alex Boag-Munroe
2024-02-27 16:11 ` Marek Szuba
2024-02-27 16:29 ` Sam James
2024-02-27 16:48 ` Andreas K. Huettel
2024-02-27 17:02 ` Ionen Wolkens
2024-02-27 17:41 ` Rich Freeman
2024-02-27 18:07 ` Ulrich Mueller
2024-02-27 18:27 ` Kenton Groombridge
2024-02-27 17:46 ` Matthias Maier
2024-02-27 17:50 ` Roy Bamford
2024-02-27 18:40 ` Peter Böhm
2024-02-27 18:04 ` Sam James
2024-03-09 14:57 ` Michał Górny
2024-02-27 19:17 ` Eli Schwartz
2024-02-28 3:05 ` Oskari Pirhonen
2024-02-28 3:12 ` Michał Górny
2024-02-28 10:08 ` Ulrich Mueller
2024-02-28 11:06 ` Matt Jolly
2024-02-28 20:20 ` Eli Schwartz
2024-03-01 7:06 ` Sam James
2024-03-09 15:00 ` Michał Górny
2024-02-28 13:09 ` Michał Górny
2024-02-28 10:34 ` David Seifert
2024-02-28 18:50 ` Arthur Zamarin
2024-02-28 19:26 ` Rich Freeman
2024-03-01 6:33 ` Zoltan Puskas
2024-03-05 6:12 ` Robin H. Johnson
2024-03-06 6:53 ` Oskari Pirhonen [this message]
2024-03-08 3:59 ` [gentoo-dev] " Duncan
2024-03-09 15:04 ` Michał Górny
2024-03-09 21:13 ` Duncan
2024-03-10 1:53 ` Eli Schwartz
2024-03-06 13:53 ` [gentoo-dev] " martin-kokos
2024-03-08 7:09 ` Fco. Javier Felix Belmonte
2024-03-21 15:25 ` Michał Górny
2024-04-15 19:50 ` Jérôme Carretero
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZegS-2AF-469KWES@dj3ntoo \
--to=xxc3ncoredxx@gmail.com \
--cc=gentoo-dev@lists.gentoo.org \
--cc=robbat2@gentoo.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox