[gentoo-user] Recommended location of the Gentoo ebuild repository

[gentoo-user] Recommended location of the Gentoo ebuild repository

[gevisz]

How would you comment the following quote from Gentoo Handbook
"In most situations, /usr/ is to be kept big: not only will it contain
  the majority of applications, it typically also hosts the Gentoo ebuild
  repository (by default located at /var/db/repos/gentoo) which already
  takes around 650 MiB."
that can be found here:
https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks ?

Have I correctly understood that the Gentoo ebuild repository default location
is /var/db/repos/gentoo but virtually everybody relocate it to /usr/ during
the installation process?

Why not change its default location to /usr/ in this case?

Where the Gentoo ebuild repository should be allocated? Why?

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Miles Malone]

It was historically in /usr/portage, it's now in /var/db/repos/gentoo.
The handbook is apparently out of date on this.  If you've got the
time I'm sure the handbook maintainers would appreciate a patch or a
bug

On Wed, 16 Dec 2020 at 21:52, gevisz <gevisz@gmail.com> wrote:
>
> How would you comment the following quote from Gentoo Handbook
> "In most situations, /usr/ is to be kept big: not only will it contain
>   the majority of applications, it typically also hosts the Gentoo ebuild
>   repository (by default located at /var/db/repos/gentoo) which already
>   takes around 650 MiB."
> that can be found here:
> https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks ?
>
> Have I correctly understood that the Gentoo ebuild repository default location
> is /var/db/repos/gentoo but virtually everybody relocate it to /usr/ during
> the installation process?
>
> Why not change its default location to /usr/ in this case?
>
> Where the Gentoo ebuild repository should be allocated? Why?
>

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[gevisz]

> On Wed, 16 Dec 2020 at 21:52, gevisz <gevisz@gmail.com> wrote:
> >
> > How would you comment the following quote from Gentoo Handbook
> > "In most situations, /usr/ is to be kept big: not only will it contain
> >   the majority of applications, it typically also hosts the Gentoo ebuild
> >   repository (by default located at /var/db/repos/gentoo) which already
> >   takes around 650 MiB."
> > that can be found here:
> > https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks ?
> >
> > Have I correctly understood that the Gentoo ebuild repository default location
> > is /var/db/repos/gentoo but virtually everybody relocate it to /usr/ during
> > the installation process?
> >
> > Why not change its default location to /usr/ in this case?
> >
> > Where the Gentoo ebuild repository should be allocated? Why?
> >
> On Wed, 16 Dec 2020 at 13:55, Miles Malone <m.malone@homicidalteddybear.net>:
>
> It was historically in /usr/portage, it's now in /var/db/repos/gentoo.
> The handbook is apparently out of date on this.  If you've got the
> time I'm sure the handbook maintainers would appreciate a patch or a
> bug

Thank you for your reply. Now, it is a bit clearer.

Nevertheless, the explanation why /var/db/repos/gentoo is better than
/usr/portage is still welcomed. :)

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Rich Freeman]

On Wed, Dec 16, 2020 at 9:45 AM gevisz <gevisz@gmail.com> wrote:
>
> Nevertheless, the explanation why /var/db/repos/gentoo is better than
> /usr/portage is still welcomed. :)
>

There is a lengthy discussion on gentoo-dev on this, and my personal
first choice didn't win.  :)

There is little dispute that /var makes more sense than /usr other
than legacy reasons.  /usr is generally used for static data - on some
distros it might even be read-only, a squashfs, signed using crypto,
and so on.  On a rolling release distro like Gentoo it might get
changed often by updates, but other than system updates nothing in it
should change.  On a more release-based distro only security updates
or major releases would touch it.

/var on the other hand is used for application data and other things
that change all the time.  That includes things like databases, which
the Gentoo repo basically is.  Mail spools, print spools, caches, and
so on all go on there.

FHS formalizes all this stuff.

Now, where exactly in /var it goes is more a matter of debate.
/var/db is not specified in FHS, but it is used by FreeBSD which I
think was one of the selling points.  Personally I stick it in
/var/cache as (IMO) it just contains a local copy of a repository that
is entirely stored elsewhere.  Some would certainly disagree with
that.  I think /var/lib would be an alternative place that keeps more
to FHS.

However, moving it out of /usr was a move with near-universal support.
And you can really put it anywhere you want by editing one line in
your portage config.  I don't think the directory even exists in the
base install - it gets created the first time you sync so it is
entirely user-configurable.

-- 
Rich

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Mark Knecht]

[-- Attachment #1: Type: text/plain, Size: 356 bytes --]

On Wed, Dec 16, 2020 at 7:46 AM gevisz <gevisz@gmail.com> wrote:
<SNIP>
> Nevertheless, the explanation why /var/db/repos/gentoo is better than
> /usr/portage is still welcomed. :)

Community opinion mostly:

https://serverfault.com/questions/384342/what-are-the-best-practices-of-the-usr-var-and-etc-folders#384345


In this case portage is a 'database'?

[-- Attachment #2: Type: text/html, Size: 653 bytes --]

[gentoo-user] Re: Recommended location of the Gentoo ebuild repository

[Nikos Chantziaras]

On 16/12/2020 13:51, gevisz wrote:
> How would you comment the following quote from Gentoo Handbook
> "In most situations, /usr/ is to be kept big: not only will it contain
>    the majority of applications, it typically also hosts the Gentoo ebuild
>    repository (by default located at /var/db/repos/gentoo) which already
>    takes around 650 MiB."
> that can be found here:
> https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks ?
> 
> Have I correctly understood that the Gentoo ebuild repository default location
> is /var/db/repos/gentoo but virtually everybody relocate it to /usr/ during
> the installation process?
> 
> Why not change its default location to /usr/ in this case?
> 
> Where the Gentoo ebuild repository should be allocated? Why?

Wherever you want. I have on /mnt/Data/gentoo/portage, so... meh :P

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[antlists]

On 16/12/2020 14:58, Mark Knecht wrote:
> 
> 
> On Wed, Dec 16, 2020 at 7:46 AM gevisz <gevisz@gmail.com 
> <mailto:gevisz@gmail.com>> wrote:
> <SNIP>
>  > Nevertheless, the explanation why /var/db/repos/gentoo is better than
>  > /usr/portage is still welcomed. :)
> 
> Community opinion mostly:
> 
> https://serverfault.com/questions/384342/what-are-the-best-practices-of-the-usr-var-and-etc-folders#384345 
> <https://serverfault.com/questions/384342/what-are-the-best-practices-of-the-usr-var-and-etc-folders#384345> 
> 
> 
> In this case portage is a 'database'?

Depends what you mean by "portage". Depends what you mean by "database".

Here we are storing the data (source files) used to build a gentoo 
system. So while it may be a bit tenuous (I find Rich's argument for 
"cache" more compelling), I don't think the argument for calling this a 
database that strange - portage the system uses portage the data to 
build the system called gentoo ...

Cheers,
Wol

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Victor Ivanov]

[-- Attachment #1.1: Type: text/plain, Size: 1833 bytes --]

On 16/12/2020 14:55, Rich Freeman wrote:
> Now, where exactly in /var it goes is more a matter of debate.
> /var/db is not specified in FHS, but it is used by FreeBSD which I
> think was one of the selling points.  Personally I stick it in
> /var/cache as (IMO) it just contains a local copy of a repository that
> is entirely stored elsewhere.  Some would certainly disagree with
> that.  I think /var/lib would be an alternative place that keeps more
> to FHS.

This is very interesting, thanks for sharing! I was wondering what the 
rationale was behind /var/db but it comes as no surprise that it may 
have something to do with FreeBSD and Gentoo's overall ties/inspiration 
from FreeBSD. Personally, I too agree that /var/cache might be a better 
approach and is commonly used by other distros to store their repos' 
cache (e.g. Debian and derivatives).

Whether it's ultimately the "right" place, I don't know but to me it 
seems one of Linux' larger issues is the general lack of consistency 
between distros. This is a whole other debate of course. And while often 
inconsistencies may stem from otherwise perfectly sound decisions, I 
think such aspects - in their cumulative form - contribute to the 
hindering of wider adoption of Linux outside the tech community.

> However, moving it out of /usr was a move with near-universal support.
> And you can really put it anywhere you want by editing one line in
> your portage config.  I don't think the directory even exists in the
> base install - it gets created the first time you sync so it is
> entirely user-configurable.

I completely agree with this, I was extremely happy when I read the news 
a while back as it makes far more sense. In fact, prior to the move I 
had been wondering with friends why the repo cache was under /usr.


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Rich Freeman]

On Wed, Dec 16, 2020 at 10:25 AM antlists <antlists@youngman.org.uk> wrote:
>
> Here we are storing the data (source files) used to build a gentoo
> system. So while it may be a bit tenuous (I find Rich's argument for
> "cache" more compelling), I don't think the argument for calling this a
> database that strange - portage the system uses portage the data to
> build the system called gentoo ...

Oh, I would agree that Portage is a database, but if you want to go
with that then /var/lib is the correct location.  /var/db is not where
you would store a database per FHS.  In FHS /var/db doesn't exist at
all. :)

Really the main difference between /var/cache and /var/lib is
value/persistance.  The point of a cache is that you can toss it at
any time and re-create it.  That isn't true of the stuff in /var/lib.
Which bucket the package repo fits into is somewhat nuanced.

-- 
Rich

Re: [gentoo-user] Re: Recommended location of the Gentoo ebuild repository

[Dale]

Nikos Chantziaras wrote:
> On 16/12/2020 13:51, gevisz wrote:
>> How would you comment the following quote from Gentoo Handbook
>> "In most situations, /usr/ is to be kept big: not only will it contain
>>    the majority of applications, it typically also hosts the Gentoo
>> ebuild
>>    repository (by default located at /var/db/repos/gentoo) which already
>>    takes around 650 MiB."
>> that can be found here:
>> https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Disks ?
>>
>> Have I correctly understood that the Gentoo ebuild repository default
>> location
>> is /var/db/repos/gentoo but virtually everybody relocate it to /usr/
>> during
>> the installation process?
>>
>> Why not change its default location to /usr/ in this case?
>>
>> Where the Gentoo ebuild repository should be allocated? Why?
>
> Wherever you want. I have on /mnt/Data/gentoo/portage, so... meh :P
>
>
>


This is true.  Where can be set in make.conf and
/etc/portage/repos.conf/gentoo.conf.  I have mine in /var/cache here. 
At one point, that seemed to be the place it was going to end up.  Then
it changed after I moved mine.  :/  Examples for OP.

/etc/portage/make.conf:DISTDIR="/var/cache/portage/distfiles/"
/etc/portage/make.conf:PKGDIR="/var/cache/portage/packages"
/etc/portage/repos.conf/gentoo.conf:location = /var/cache/portage/tree

root@fireball / # ls -l /var/cache/portage/
total 152
drwxrwxr-x   3 portage portage 143360 Dec 13 22:42 distfiles
drwxrwxr-x 108 portage portage   4096 Dec 13 22:40 packages
drwxr-xr-x 174 portage portage   4096 Dec 12 18:25 tree
root@fireball / #


OP, with that info, it should help you put it wherever you want.  Don't
forget to check the permissions, owners and group settings too. 

Hope that helps.

Dale

:-)  :-) 

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[gevisz]

ср, 16 дек. 2020 г. в 16:55, Rich Freeman <rich0@gentoo.org>:
>
> On Wed, Dec 16, 2020 at 9:45 AM gevisz <gevisz@gmail.com> wrote:
> >
> > Nevertheless, the explanation why /var/db/repos/gentoo is better than
> > /usr/portage is still welcomed. :)
> >
>
> There is a lengthy discussion on gentoo-dev on this, and my personal
> first choice didn't win.  :)
>
> There is little dispute that /var makes more sense than /usr other
> than legacy reasons.  /usr is generally used for static data - on some
> distros it might even be read-only, a squashfs, signed using crypto,
> and so on.  On a rolling release distro like Gentoo it might get
> changed often by updates, but other than system updates nothing in it
> should change.  On a more release-based distro only security updates
> or major releases would touch it.
>
> /var on the other hand is used for application data and other things
> that change all the time.  That includes things like databases, which
> the Gentoo repo basically is.  Mail spools, print spools, caches, and
> so on all go on there.
>
> FHS formalizes all this stuff.
>
> Now, where exactly in /var it goes is more a matter of debate.
> /var/db is not specified in FHS, but it is used by FreeBSD which I
> think was one of the selling points.  Personally I stick it in
> /var/cache as (IMO) it just contains a local copy of a repository that
> is entirely stored elsewhere.  Some would certainly disagree with
> that.  I think /var/lib would be an alternative place that keeps more
> to FHS.
>
> However, moving it out of /usr was a move with near-universal support.
> And you can really put it anywhere you want by editing one line in
> your portage config.  I don't think the directory even exists in the
> base install - it gets created the first time you sync so it is
> entirely user-configurable.

Ok, thank you for the explanation.

Re: [gentoo-user] Recommended location of the Gentoo ebuild repository

[Mark Knecht]

[-- Attachment #1: Type: text/plain, Size: 1411 bytes --]

On Wed, Dec 16, 2020 at 8:26 AM antlists <antlists@youngman.org.uk> wrote:
>
> On 16/12/2020 14:58, Mark Knecht wrote:
> >
> >
> > On Wed, Dec 16, 2020 at 7:46 AM gevisz <gevisz@gmail.com
> > <mailto:gevisz@gmail.com>> wrote:
> > <SNIP>
> >  > Nevertheless, the explanation why /var/db/repos/gentoo is better than
> >  > /usr/portage is still welcomed. :)
> >
> > Community opinion mostly:
> >
> >
https://serverfault.com/questions/384342/what-are-the-best-practices-of-the-usr-var-and-etc-folders#384345
> > <
https://serverfault.com/questions/384342/what-are-the-best-practices-of-the-usr-var-and-etc-folders#384345
>
> >
> >
> > In this case portage is a 'database'?
>
> Depends what you mean by "portage". Depends what you mean by "database".
>
> Here we are storing the data (source files) used to build a gentoo
> system. So while it may be a bit tenuous (I find Rich's argument for
> "cache" more compelling), I don't think the argument for calling this a
> database that strange - portage the system uses portage the data to
> build the system called gentoo ...
>
> Cheers,
> Wol

Better explanation than my answer/question/comment.

But yes, portage is (I think) a complete system of things, emerge,
depclean, world file and the directories residing under /usr/portage. It's
only that directory structure that changes often and is subject to being
given a description such as 'database'.

Thanks,
Mark

[-- Attachment #2: Type: text/html, Size: 2194 bytes --]

Re: [gentoo-user] Re: Recommended location of the Gentoo ebuild repository

[Peter Humphrey]

On Wednesday, 16 December 2020 15:41:11 GMT Dale wrote:

> This is true.  Where can be set in make.conf and
> /etc/portage/repos.conf/gentoo.conf.

I thought that setting this in make.conf was frowned on these days, no?

-- 
Regards,
Peter.

Re: [gentoo-user] Re: Recommended location of the Gentoo ebuild repository

[Dale]

Peter Humphrey wrote:
> On Wednesday, 16 December 2020 15:41:11 GMT Dale wrote:
>
>> This is true.  Where can be set in make.conf and
>> /etc/portage/repos.conf/gentoo.conf.
> I thought that setting this in make.conf was frowned on these days, no?
>


From my understanding, the setting for the tree is in gentoo.conf.  The
setting for distfiles and packages are still set in make.conf.  Since
mine is not a default setting and it works, it must be using them
otherwise it would be somewhere else or puking on my keyboard about
something missing.  Wouldn't it? 

Dale

:-)  :-) 

Re: [gentoo-user] Re: Recommended location of the Gentoo ebuild repository

[Peter Humphrey]

On Sunday, 20 December 2020 17:16:53 GMT Dale wrote:
> Peter Humphrey wrote:
> > On Wednesday, 16 December 2020 15:41:11 GMT Dale wrote:
> >> This is true.  Where can be set in make.conf and
> >> /etc/portage/repos.conf/gentoo.conf.
> > 
> > I thought that setting this in make.conf was frowned on these days, no?
> 
> From my understanding, the setting for the tree is in gentoo.conf.  The
> setting for distfiles and packages are still set in make.conf.  Since
> mine is not a default setting and it works, it must be using them
> otherwise it would be somewhere else or puking on my keyboard about
> something missing.  Wouldn't it? 

Yes, that's my understanding too. :)

-- 
Regards,
Peter.