[gentoo-proxy-maint] Repoman: Need user access

[gentoo-proxy-maint] Repoman: Need user access

[Vieri]

[-- Attachment #1: Type: text/plain, Size: 9570 bytes --]

Hi,

I'm unable to understand why repoman complains about "user access". I am runing it as non-root, but I don't know why it can't fetch  metadata.xsd.

$ repoman -vv manifest
[DEBUG] FindVCS: found git dir: /home/vdipaola/mygithub/gentoo/.git
[DEBUG] repoman_main: RepoSettings init
[DEBUG] RepoSettings: init(); load qadata
[DEBUG] QAData: cnfdir: /usr/share/repoman/qa_data, repomanpaths: ['/usr/share/repoman/qa_data/qa_data.yaml']
[DEBUG] qa_help primary keys: ['DESCRIPTION', 'EAPI', 'Entries', 'HOMEPAGE', 'IUSE', 'KEYWORDS', 'LICENSE', 'LIVEVCS', 'PDEPEND', 'PROPERTIES', 'RDEPEND', 'REQUIRED_USE', 'RESTRICT', 'SLOT', 'SRC_URI', 'changelog', 'dependency', 'digest', 'ebuild', 'file', 'inherit', 'java', 'manifest', 'metadata', 'portage', 'repo', 'upstream', 'uri', 'usage', 'variable', 'virtual', 'wxwidgets']
[DEBUG] QAData: missingvars: ['KEYWORDS', 'LICENSE', 'DESCRIPTION', 'HOMEPAGE']
[DEBUG] QAData: completed loading file: ['/usr/share/repoman/repository/qa_data.yaml']
[DEBUG] RepoSettings: qadata loaded: frozenset({'Manifest', 'ChangeLog', 'metadata.xml'})
[DEBUG] repoman_main: vcs_settings done
[DEBUG] repoman_main: qadata: <repoman.qa_data.QAData object at 0x7f0d2d92cc88>
[DEBUG] vcs: git
[DEBUG] repo config: {'aliases': None, 'allow_missing_manifest': False, 'allow_provide_virtual': False, 'auto_sync': 'yes', 'cache_formats': ('md5-dict',), 'clone_depth': None, 'create_manifest': True, 'disable_manifest': False, 'eapi': '0', 'eclass_db': <portage.eclass_cache.cache object at 0x7f0d2d8592e8>, 'eclass_locations': ('/home/vdipaola/mygithub/gentoo',), 'eclass_overrides': None, 'find_invalid_path_char': <function _find_invalid_path_char at 0x7f0d2e5399d8>, 'force': None, 'format': None, 'local_config': False, 'location': '/home/vdipaola/mygithub/gentoo', 'main_repo': 'gentoo', 'manifest_hashes': frozenset({'BLAKE2B', 'SHA512'}), 'manifest_required_hashes': frozenset({'BLAKE2B'}), 'masters': (), 'missing_repo_name': False, 'module_specific_options': {'sync-rsync-verify-jobs': '1', 'sync-rsync-extra-opts': '', 'sync-rsync-verify-max-age': '24', 'sync-rsync-verify-metamanifest': 'yes'}, 'name': 'gentoo', 'portage1_profiles': True, 'portage1_profiles_compat': True, 'priority': -1000, 'profile_formats': ('portage-1-compat',), 'sign_commit': True, 'sign_manifest': False, 'strict_misc_digests': True, 'sync_allow_hardlinks': True, 'sync_depth': None, 'sync_hooks_only_on_change': False, 'sync_openpgp_key_path': '/usr/share/openpgp-keys/gentoo-release.asc', 'sync_openpgp_key_refresh_retry_count': '40', 'sync_openpgp_key_refresh_retry_delay_exp_base': '2', 'sync_openpgp_key_refresh_retry_delay_max': '60', 'sync_openpgp_key_refresh_retry_delay_mult': '4', 'sync_openpgp_key_refresh_retry_overall_timeout': '1200', 'sync_rcu': False, 'sync_rcu_spare_snapshots': None, 'sync_rcu_store_dir': None, 'sync_rcu_ttl_days': None, 'sync_type': 'rsync', 'sync_umask': None, 'sync_uri': 'rsync://rsync.gentoo.org/gentoo-portage', 'sync_user': None, 'thin_manifest': True, 'update_changelog': False, 'user_location': '/home/vdipaola/mygithub/gentoo', '_eapis_banned': frozenset({'3', '1'}), '_eapis_deprecated': frozenset({'0', '5', '2', '4'}), '_masters_orig': ()}
[DEBUG] options: Namespace(ask=False, bug=[], closes=[], commitmsg=None, commitmsgfile=None, digest=None, echangelog=None, experimental_inherit='n', experimental_repository_modules='n', force=False, if_modified='n', ignore_arches=False, ignore_default_opts=False, ignore_masked=False, include_arches=None, include_dev=False, include_exp_profiles=False, mode='manifest', output_style='default', pretend=False, quiet=0, straight_to_stable=False, unmatched_removal=False, vcs=None, verbosity=2, version=False, without_mask=False, xml_parse=False)
[DEBUG] Found the following packages to scan:
net-proxy/c-icap
[DEBUG] ModuleConfig; configpaths: ['/usr/share/repoman/repository/repository.yaml']
[DEBUG] ModuleConfig; module_names: ['description', 'eapi', 'ebuild', 'ebuild_metadata', 'fetches', 'files', 'keywords', 'live', 'manifests', 'mtime', 'multicheck', 'options', 'pkgmetadata', 'profile', 'restrict', 'ruby']
[DEBUG] ModuleConfig; Processing: /usr/share/repoman/repository/repository.yaml
[DEBUG] ModuleConfig; completed : /usr/share/repoman/repository/repository.yaml
[DEBUG] ModuleConfig; new _configs: [{'version': 1, 'repoman_version': '2.3.3', 'scan_modules': 'description eapi ebuild_metadata fetches files keywords live manifests multicheck pkgmetadata profile restrict ruby', 'linechecks_modules': 'assignment eapi3assignment implicitdepend hasq useq preservelib bindnow inherit dosym definition srcprepare eapi3deprecated pkgpretend eapi4incompatible eapi4gonevars paralleldisabled autodefault gentooheader nooffset nesteddie patches emakeparallel srccompileeconf srcunpackpatches portageinternal portageinternalvariableassignment quote quoteda httpsuri builtwith uselesscds uselessdodoc whitespace blankline addpredict noasneeded'}]
[DEBUG] ModuleConfig; Processing loop pkgs
[DEBUG] ModuleConfig; checking loop pkgs, module: ebuild, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: mtime, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: description, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: eapi, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: ebuild_metadata, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: fetches, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: files, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop pkgs, module: keywords, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop pkgs, module: live, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: manifests, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop pkgs, module: multicheck, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: pkgmetadata, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop pkgs, module: profile, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: restrict, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop pkgs, module: ruby, in: ['ebuilds']
[DEBUG] ModuleConfig; mlist: ['ebuild', 'fetches', 'files', 'keywords', 'manifests', 'pkgmetadata']
[DEBUG] ModuleConfig; Processing loop ebuilds
[DEBUG] ModuleConfig; checking loop ebuilds, module: ebuild, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: mtime, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: description, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: eapi, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: ebuild_metadata, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: fetches, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: files, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop ebuilds, module: keywords, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop ebuilds, module: live, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: manifests, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop ebuilds, module: multicheck, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: pkgmetadata, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop ebuilds, module: profile, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: restrict, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop ebuilds, module: ruby, in: ['ebuilds']
[DEBUG] ModuleConfig; mlist: ['ebuild', 'mtime', 'description', 'eapi', 'ebuild_metadata', 'fetches', 'keywords', 'live', 'multicheck', 'pkgmetadata', 'profile', 'restrict', 'ruby']
[DEBUG] ModuleConfig; Processing loop final
[DEBUG] ModuleConfig; checking loop final, module: ebuild, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: mtime, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: description, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: eapi, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: ebuild_metadata, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: fetches, in: ['pkgs', 'ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: files, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop final, module: keywords, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop final, module: live, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: manifests, in: ['pkgs']
[DEBUG] ModuleConfig; checking loop final, module: multicheck, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: pkgmetadata, in: ['pkgs', 'ebuilds', 'final']
[DEBUG] ModuleConfig; checking loop final, module: profile, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: restrict, in: ['ebuilds']
[DEBUG] ModuleConfig; checking loop final, module: ruby, in: ['ebuilds']
[DEBUG] ModuleConfig; mlist: ['keywords', 'pkgmetadata']

*** the local copy of metadata.xsd needs to be refetched, doing that now


Repoman: Need user access

I have a gentoo git clone in my user's home dir, a custom overlay, and the main protage tree. No metadat.xsd file to be found anywhere except:

# find /usr/portage/ -name "metadata.xsd"
/usr/portage/distfiles/metadata.xsd
/usr/portage/metadata/xml-schema/metadata.xsd

I don't know what this file is for, but I wish repoman could be a bit more verbose.

Thanks,

Vieri

[-- Attachment #2: Type: text/html, Size: 10114 bytes --]

Re: [gentoo-proxy-maint] Repoman: Need user access

[Joonas Niilola]

[-- Attachment #1: Type: text/plain, Size: 885 bytes --]


On 12/12/18 10:42 AM, Vieri wrote:
> Hi,
>
> I'm unable to understand why repoman complains about "user access". I 
> am runing it as non-root, but I don't know why it can't fetch 
> metadata.xsd.
>
>
> Repoman: Need user access
>
> I have a gentoo git clone in my user's home dir, a custom overlay, and 
> the main protage tree. No metadat.xsd file to be found anywhere except:
>
> # find /usr/portage/ -name "metadata.xsd"
> /usr/portage/distfiles/metadata.xsd
> /usr/portage/metadata/xml-schema/metadata.xsd
>
> I don't know what this file is for, but I wish repoman could be a bit 
> more verbose.
>
>

Make sure your user is in 'portage' group, and make sure your portage 
group has write access to your portage's DISTDIR. Looks to me like 
something isn't set up correctly.


repoman uses your global make.conf for few things, not sure if you can 
make user-defined settings.



[-- Attachment #2: Type: text/html, Size: 2272 bytes --]

Re: [gentoo-proxy-maint] Repoman: Need user access

[Sarah White]

On 12/12/18 8:32 AM, Joonas Niilola wrote:
> 
> On 12/12/18 10:42 AM, Vieri wrote:
>> Hi,
>>
>> I'm unable to understand why repoman complains about "user access". I
>> am runing it as non-root, but I don't know why it can't fetch
>> metadata.xsd.
>>
>>
>> Repoman: Need user access
>>
>> I have a gentoo git clone in my user's home dir, a custom overlay, and
>> the main protage tree. No metadat.xsd file to be found anywhere except:
>>
>> # find /usr/portage/ -name "metadata.xsd"
>> /usr/portage/distfiles/metadata.xsd
>> /usr/portage/metadata/xml-schema/metadata.xsd
>>
>> I don't know what this file is for, but I wish repoman could be a bit
>> more verbose.
>>
>>
> 
> Make sure your user is in 'portage' group, and make sure your portage
> group has write access to your portage's DISTDIR. Looks to me like
> something isn't set up correctly.
> 
> 
> repoman uses your global make.conf for few things, not sure if you can
> make user-defined settings.
> 
> 
> 

This is the correct workaround. The problem goes away any time I've
experienced it by making sure my non-root user is member of the portage
user group, and verifying permissions on DISTDIR (typically
/usr/portage/distfiles) - the most I've ever had to do was re-log or
reboot after checking those settings.

Good luck

Re: [gentoo-proxy-maint] Repoman: Need user access

[Vieri]

On Wednesday, December 12, 2018, 2:56:39 PM GMT+1, Sarah White <kuzetsa@gmail.com> wrote: 
>
> This is the correct workaround. The problem goes away any time I've
> experienced it by making sure my non-root user is member of the portage
> user group, and verifying permissions on DISTDIR (typically
> /usr/portage/distfiles) - the most I've ever had to do was re-log or
> reboot after checking those settings.

I'll try to add my user to the portage group.
Before doing so, I also tried to run "emerge --sync" as root, but running repoman as the user still yields the same message.
I was kind of hoping not to touch the user's groups especially since it's a pam-winbind authenticated user.
Anyway, as I apparently have no choice I did:

# usermod -a -G portage my_user
# groups my_user
portage domain users

Now I get this:

 $ repoman manifest
*** the local copy of metadata.xsd needs to be refetched, doing that now
--2018-12-12 15:54:01--  https://www.gentoo.org/xml-schema/metadata.xsd
[snip]
2018-12-12 15:54:02 (109 MB/s) - '/usr/portage/distfiles/metadata.xsd.c_zl6in2' saved [18186/18186]

>>> Creating Manifest for blabla

I'm not 100% sure, but the file doesn't seem to have changed (at least based on the timestamp).

To sum it all up:

1) is it safe/common practice to add the user to the portage group?
2) can 1) be avoided by running repoman as root just once and only when this type of error shows up?

Thanks,

Vieri

Re: [gentoo-proxy-maint] Repoman: Need user access

[Thomas Deutschmann]

[-- Attachment #1.1: Type: text/plain, Size: 169 bytes --]

Hi,

this is bug https://bugs.gentoo.org/574130.


-- 
Regards,
Thomas Deutschmann / Gentoo Linux Developer
C4DD 695F A713 8F24 2AA1 5638 5849 7EE5 1D5D 74A5


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 618 bytes --]

Re: [gentoo-proxy-maint] Repoman: Need user access

[Vieri]

 On Thursday, December 13, 2018, 5:04:19 PM GMT+1, Thomas Deutschmann <whissi@gentoo.org> wrote: 
>
> this is bug https://bugs.gentoo.org/574130.

Thank you very much for pointing that out.

I added that to my beginner's guide at:

https://forums.gentoo.org/viewtopic-p-8287620.html

Being a novice myself, I found that the current info on Gentoo Wiki is not 100% complete.
It's currently only a draft that I use to contribute, and it seems to be working fine for me. However, if anyone has the time to take a quick glance at it and suggest changes, I'd greatly appreciate it.

Thanks,

Vieri