[gentoo-user] problem installing confluent-kafka from guru

[gentoo-user] problem installing confluent-kafka from guru

[Anatoly Oreshkin]

[-- Attachment #1: Type: text/plain, Size: 3368 bytes --]

Hello,

I am a newbie to Gentoo.
As end user I am  using package confluent-kafka from guru repository.
To install it I have performed the following steps in command line:

1. sudo emerge app-eselect/eselect-repository
2. sudo mkdir /etc/portage/repos.conf
3. sudo eselect repository enable guru
4. sudo emaint sync -r guru;  emerge --sync
5. cat > /etc/portage/package.accept_keywords/confluent-kafka <<EOF
dev-python/confluent-kafka ~amd64
dev-python/fastavro ~amd64
dev-python/favro ~amd64
dev-python/avro ~amd64
net-misc/kafka-bin ~amd64
EOF
6. modify
/var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
sed -i 's/python3_8/python3_9/g'
/var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild


7. sudo emerge  dev-python/confluent-kafka

Everything is OK. The package dev-python/confluent-kafka is installed.

emerge --search dev-python/confluent-kafka
[ Results for search key : dev-python/confluent-kafka ]
Searching...

*  dev-python/confluent-kafka
     Latest version available: 1.7.0
     Latest version installed: 1.7.0
     Size of files: 101 KiB
     Homepage:      https://pypi.org/project/confluent-kafka
https://github.com/confluentinc/confluent-kafka-python
     Description:   Confluent's Kafka Python Client
     License:       Apache-2.0
Then I have tried to install dev-python/confluent-kafka using SaltStack.
Here is init.sls for installing dev-python/confluent-kafka:

# install eselect-repository
app-eselect/eselect-repository:
 pkg:
   - installed
   - names:
     - app-eselect/eselect-repository
/etc/portage/repos.conf:
 file.directory:
   - name: /etc/portage/repos.conf
   - user: root
   - group: root
   - mode: 755
   - require:
     - app-eselect/eselect-repository
# add GURU repository
add_guru:
 cmd.run:
   - name: eselect repository enable guru; emaint sync -r guru;  emerge
--sync
   - require:
     - /etc/portage/repos.conf

dev-libs/librdkafka:
 pkg:
   - installed
   - name:
     - dev-libs/librdkafka

/etc/portage/package.accept_keywords/confluent-kafka:
 file.managed:
   - create: True
   - contents:
     - dev-python/confluent-kafka ~amd64
     - dev-python/fastavro ~amd64
     - dev-python/favro ~amd64
     - dev-python/avro ~amd64
     - net-misc/kafka-bin ~amd64


# modify
/var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
confluent-kafka-1.7.0.ebuild:
 cmd.run:
   - name:  sed -i 's/python3_8/python3_9/g'
/var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
   - require:
     - add_guru
     - /etc/portage/package.accept_keywords/confluent-kafka


dev-python/confluent-kafka:
 pkg:
   - installed
   - name: dev-python/confluent-kafka
   - require:
     - confluent-kafka-1.7.0.ebuild
     - dev-libs/librdkafka
     - add_guru


I've received the error while installing dev-python/confluent-kafka:

The following package(s) were not found, and no possible matches were found
in the package db: dev-python/confluent-kafka.

However guru repository  is added to my gentoo installation and
 dev-python/confluent-kafka is available.
So I can install dev-python/confluent-kafka in command line  by command:

sudo emerge  dev-python/confluent-kafka

or just once more rerunning SaltStack init.sls

What may be the reason ?  Any ideas, hints ?
Thank you.

[-- Attachment #2: Type: text/html, Size: 4046 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Matt Connell (Gmail)]

On Tue, 2022-02-22 at 10:02 +0300, Anatoly Oreshkin wrote:
> The following package(s) were not found, and no possible matches were
> found in the package db: dev-python/confluent-kafka.

I've never used a gentoo system with salt stack, but I had a thought. 
Salt can be picky with package names sometimes.

Try specifying the package name this way, with the repository
explicitly specified:

dev-python/confluent-kafka::guru

Re: [gentoo-user] problem installing confluent-kafka from guru

[Anatoly Oreshkin]

[-- Attachment #1: Type: text/plain, Size: 1040 bytes --]

Hi,
Unfortunately specifying dev-python/confluent-kafka::guru hasn't helped.
I've received the same error message:
         ID: dev-python/confluent-kafka
   Function: pkg.installed
       Name: dev-python/confluent-kafka::guru
     Result: False
    Comment: The following package(s) were not found, and no possible
matches were found in the package db: dev-pyt
hon/confluent-kafka::guru


    Started: 08:23:53.928495
   Duration: 61.712 ms
    Changes:





вт, 22 февр. 2022 г. в 17:42, Matt Connell (Gmail) <
matthewdconnell@gmail.com>:

> On Tue, 2022-02-22 at 10:02 +0300, Anatoly Oreshkin wrote:
> > The following package(s) were not found, and no possible matches were
> > found in the package db: dev-python/confluent-kafka.
>
> I've never used a gentoo system with salt stack, but I had a thought.
> Salt can be picky with package names sometimes.
>
> Try specifying the package name this way, with the repository
> explicitly specified:
>
> dev-python/confluent-kafka::guru
>
>
>
>

[-- Attachment #2: Type: text/html, Size: 3015 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Matt Connell (Gmail)]

On Wed, 2022-02-23 at 11:28 +0300, Anatoly Oreshkin wrote:
> Unfortunately specifying dev-python/confluent-kafka::guru hasn't
> helped.

Unfortunately I don't have any better ideas.  I've had more problems
with the pkg.installed state than any other single thing in Salt.

If you states don't need to be extended to other platforms, you could
just resort to cmd.run again.  Seems you're already doing that with
emaint anyway.

Re: [gentoo-user] problem installing confluent-kafka from guru

[Anatoly Oreshkin]

[-- Attachment #1: Type: text/plain, Size: 867 bytes --]

To work around my problem I've changed state dev-python/confluent-kafka to
this variant:

dev-python/confluent-kafka:
  cmd.run:
    - name: emerge dev-python/confluent-kafka
    - require:
      - confluent-kafka-1.7.0.ebuild
      - dev-libs/librdkafka
      - add_guru

It works !
Thanks.



чт, 24 февр. 2022 г. в 00:55, Matt Connell (Gmail) <
matthewdconnell@gmail.com>:

> On Wed, 2022-02-23 at 11:28 +0300, Anatoly Oreshkin wrote:
> > Unfortunately specifying dev-python/confluent-kafka::guru hasn't
> > helped.
>
> Unfortunately I don't have any better ideas.  I've had more problems
> with the pkg.installed state than any other single thing in Salt.
>
> If you states don't need to be extended to other platforms, you could
> just resort to cmd.run again.  Seems you're already doing that with
> emaint anyway.
>
>
>

[-- Attachment #2: Type: text/html, Size: 1326 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Alessandro Barbieri]

[-- Attachment #1: Type: text/plain, Size: 692 bytes --]

Il giorno mar 22 feb 2022 alle ore 08:02 Anatoly Oreshkin <
anatoly.oreshkin@gmail.com> ha scritto:

> Hello,
>
> I am a newbie to Gentoo.
> As end user I am  using package confluent-kafka from guru repository.
> To install it I have performed the following steps in command line:
> [...]
> 6. modify
> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
> change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
> sed -i 's/python3_8/python3_9/g'
> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>

sorry but you can't do this, you have to stick with python3.8
I plan to update the openstack packages next month after I graduate

[-- Attachment #2: Type: text/html, Size: 1038 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Anatoly Oreshkin]

[-- Attachment #1: Type: text/plain, Size: 1079 bytes --]

сб, 26 февр. 2022 г. в 03:40, Alessandro Barbieri <lssndrbarbieri@gmail.com
>:

> Il giorno mar 22 feb 2022 alle ore 08:02 Anatoly Oreshkin <
> anatoly.oreshkin@gmail.com> ha scritto:
>
>> Hello,
>>
>> I am a newbie to Gentoo.
>> As end user I am  using package confluent-kafka from guru repository.
>> To install it I have performed the following steps in command line:
>> [...]
>> 6. modify
>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>> change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
>> sed -i 's/python3_8/python3_9/g'
>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>
>
> sorry but you can't do this, you have to stick with python3.8
> I plan to update the openstack packages next month after I graduate
>


If I don't change  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
python3_9 )  then
I will not able to install dev-python/confluent-kafka using emerge.

By the way what is the link between openstack packages  and
dev-python/confluent-kafka ?

[-- Attachment #2: Type: text/html, Size: 1838 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Alessandro Barbieri]

[-- Attachment #1: Type: text/plain, Size: 1391 bytes --]

Il Dom 27 Feb 2022, 10:34 Anatoly Oreshkin <anatoly.oreshkin@gmail.com> ha
scritto:

>
>
> сб, 26 февр. 2022 г. в 03:40, Alessandro Barbieri <
> lssndrbarbieri@gmail.com>:
>
>> Il giorno mar 22 feb 2022 alle ore 08:02 Anatoly Oreshkin <
>> anatoly.oreshkin@gmail.com> ha scritto:
>>
>>> Hello,
>>>
>>> I am a newbie to Gentoo.
>>> As end user I am  using package confluent-kafka from guru repository.
>>> To install it I have performed the following steps in command line:
>>> [...]
>>> 6. modify
>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>> change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
>>> sed -i 's/python3_8/python3_9/g'
>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>>
>>
>> sorry but you can't do this, you have to stick with python3.8
>> I plan to update the openstack packages next month after I graduate
>>
>
>
> If I don't change  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
> python3_9 )  then
> I will not able to install dev-python/confluent-kafka using emerge.
>

This isn't true, I can install it as-is in my system and in my test chroot.
You have to set your python targets to python3.8


> By the way what is the link between openstack packages  and
> dev-python/confluent-kafka ?
>

confluent-kafka is a test dependency

>

[-- Attachment #2: Type: text/html, Size: 2963 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Anatoly Oreshkin]

[-- Attachment #1: Type: text/plain, Size: 4267 bytes --]

вт, 1 мар. 2022 г. в 03:18, Alessandro Barbieri <lssndrbarbieri@gmail.com>:

> Il Dom 27 Feb 2022, 10:34 Anatoly Oreshkin <anatoly.oreshkin@gmail.com>
> ha scritto:
>
>>
>>
>> сб, 26 февр. 2022 г. в 03:40, Alessandro Barbieri <
>> lssndrbarbieri@gmail.com>:
>>
>>> Il giorno mar 22 feb 2022 alle ore 08:02 Anatoly Oreshkin <
>>> anatoly.oreshkin@gmail.com> ha scritto:
>>>
>>>> Hello,
>>>>
>>>> I am a newbie to Gentoo.
>>>> As end user I am  using package confluent-kafka from guru repository.
>>>> To install it I have performed the following steps in command line:
>>>> [...]
>>>> 6. modify
>>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>>> change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
>>>> sed -i 's/python3_8/python3_9/g'
>>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>>>
>>>
>>> sorry but you can't do this, you have to stick with python3.8
>>> I plan to update the openstack packages next month after I graduate
>>>
>>
>>
>> If I don't change  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
>> python3_9 )  then
>> I will not able to install dev-python/confluent-kafka using emerge.
>>
>
> This isn't true, I can install it as-is in my system and in my test chroot.
> You have to set your python targets to python3.8
>
>
The version of python installed in my local gentoo installation is
localhost ~ # python3 --version
Python 3.9.9

therefore I changed  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
python3_9 )
What is wrong with changing PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
python3_9 ) ?
I have tested confluent-kafka installed with python3_9 and i works !

Nevertheless I have followed your advice.
As far as I understood you I did the following steps:

1. Created the file /etc/portage/package.use/confluent-kafka:
dev-python/confluent-kafka PYTHON_TARGETS: -* python3_8

2. emerge  --autounmask-write dev-python/confluent-kafka

Autounmask changes successfully written.

 * IMPORTANT: config file '/etc/portage/package.use/grub' needs updating.
 * See the CONFIGURATION FILES and CONFIGURATION FILES UPDATE TOOLS
 * sections of the emerge man page to learn how to update config files.

3. etc-update
The following is the list of files which need updating, each
configuration file is followed by a list of possible replacement files.
1) /etc/portage/package.use/grub (1)
Please select a file to edit by entering the corresponding number.
              (don't use -3, -5, -7 or -9 if you're unsure what to do)
              (-1 to exit) (-3 to auto merge all files)
                           (-5 to auto-merge AND not use 'mv -i')
                           (-7 to discard all updates)
                           (-9 to discard all updates AND not use 'rm -i'):
-3
Replacing /etc/portage/package.use/grub with
/etc/portage/package.use/._cfg0000_grub
mv: overwrite '/etc/portage/package.use/grub'? yes
Exiting: Nothing left to do; exiting. :)

4. emerge  --autounmask-write dev-python/confluent-kafka
...
running install_scripts
 * Using python3.8 in global scope
 * python3_8: running distutils-r1_run_phase distutils-r1_python_install_all
>>> Completed installing dev-python/confluent-kafka-1.7.0 into
/var/tmp/portage/dev-python/confluent-kafka-1.7.0/image
...
>>> Installing (42 of 42) dev-python/confluent-kafka-1.7.0::guru

>>> Recording dev-python/confluent-kafka in "world" favorites file...
>>> Auto-cleaning packages...

>>> No outdated packages were found on your system.

Now package dev-python/confluent-kafka with python 3.8 is installed

emerge --search confluent-kafka
  dev-python/confluent-kafka
      Latest version available: 1.7.0
      Latest version installed: 1.7.0
      Size of files: 101 KiB
      Homepage:      https://pypi.org/project/confluent-kafka
https://github.com/confluentinc/confluent-kafka-python
      Description:   Confluent's Kafka Python Client
      License:       Apache-2.0

Is this correct ?


















>
>> By the way what is the link between openstack packages  and
>> dev-python/confluent-kafka ?
>>
>
> confluent-kafka is a test dependency
>

[-- Attachment #2: Type: text/html, Size: 7077 bytes --]

Re: [gentoo-user] problem installing confluent-kafka from guru

[Alessandro Barbieri]

[-- Attachment #1: Type: text/plain, Size: 4583 bytes --]

Il Mar 1 Mar 2022, 16:25 Anatoly Oreshkin <anatoly.oreshkin@gmail.com> ha
scritto:

>
>
> вт, 1 мар. 2022 г. в 03:18, Alessandro Barbieri <lssndrbarbieri@gmail.com
> >:
>
>> Il Dom 27 Feb 2022, 10:34 Anatoly Oreshkin <anatoly.oreshkin@gmail.com>
>> ha scritto:
>>
>>>
>>>
>>> сб, 26 февр. 2022 г. в 03:40, Alessandro Barbieri <
>>> lssndrbarbieri@gmail.com>:
>>>
>>>> Il giorno mar 22 feb 2022 alle ore 08:02 Anatoly Oreshkin <
>>>> anatoly.oreshkin@gmail.com> ha scritto:
>>>>
>>>>> Hello,
>>>>>
>>>>> I am a newbie to Gentoo.
>>>>> As end user I am  using package confluent-kafka from guru repository.
>>>>> To install it I have performed the following steps in command line:
>>>>> [...]
>>>>> 6. modify
>>>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>>>> change PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=( python3_9 )
>>>>> sed -i 's/python3_8/python3_9/g'
>>>>> /var/db/repos/guru/dev-python/confluent-kafka/confluent-kafka-1.7.0.ebuild
>>>>>
>>>>
>>>> sorry but you can't do this, you have to stick with python3.8
>>>> I plan to update the openstack packages next month after I graduate
>>>>
>>>
>>>
>>> If I don't change  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
>>> python3_9 )  then
>>> I will not able to install dev-python/confluent-kafka using emerge.
>>>
>>
>> This isn't true, I can install it as-is in my system and in my test
>> chroot.
>> You have to set your python targets to python3.8
>>
>>
> The version of python installed in my local gentoo installation is
> localhost ~ # python3 --version
> Python 3.9.9
>
> therefore I changed  PYTHON_COMPAT=( python3_8 )  -> PYTHON_COMPAT=(
> python3_9 )
> What is wrong with changing PYTHON_COMPAT=( python3_8 )  ->
> PYTHON_COMPAT=( python3_9 ) ?
> I have tested confluent-kafka installed with python3_9 and i works !
>
> Nevertheless I have followed your advice.
> As far as I understood you I did the following steps:
>
> 1. Created the file /etc/portage/package.use/confluent-kafka:
> dev-python/confluent-kafka PYTHON_TARGETS: -* python3_8
>
> 2. emerge  --autounmask-write dev-python/confluent-kafka
>
> Autounmask changes successfully written.
>
>  * IMPORTANT: config file '/etc/portage/package.use/grub' needs updating.
>  * See the CONFIGURATION FILES and CONFIGURATION FILES UPDATE TOOLS
>  * sections of the emerge man page to learn how to update config files.
>
> 3. etc-update
> The following is the list of files which need updating, each
> configuration file is followed by a list of possible replacement files.
> 1) /etc/portage/package.use/grub (1)
> Please select a file to edit by entering the corresponding number.
>               (don't use -3, -5, -7 or -9 if you're unsure what to do)
>               (-1 to exit) (-3 to auto merge all files)
>                            (-5 to auto-merge AND not use 'mv -i')
>                            (-7 to discard all updates)
>                            (-9 to discard all updates AND not use 'rm
> -i'): -3
> Replacing /etc/portage/package.use/grub with
> /etc/portage/package.use/._cfg0000_grub
> mv: overwrite '/etc/portage/package.use/grub'? yes
> Exiting: Nothing left to do; exiting. :)
>
> 4. emerge  --autounmask-write dev-python/confluent-kafka
> ...
> running install_scripts
>  * Using python3.8 in global scope
>  * python3_8: running distutils-r1_run_phase
> distutils-r1_python_install_all
> >>> Completed installing dev-python/confluent-kafka-1.7.0 into
> /var/tmp/portage/dev-python/confluent-kafka-1.7.0/image
> ...
> >>> Installing (42 of 42) dev-python/confluent-kafka-1.7.0::guru
>
> >>> Recording dev-python/confluent-kafka in "world" favorites file...
> >>> Auto-cleaning packages...
>
> >>> No outdated packages were found on your system.
>
> Now package dev-python/confluent-kafka with python 3.8 is installed
>
> emerge --search confluent-kafka
>   dev-python/confluent-kafka
>       Latest version available: 1.7.0
>       Latest version installed: 1.7.0
>       Size of files: 101 KiB
>       Homepage:      https://pypi.org/project/confluent-kafka
> https://github.com/confluentinc/confluent-kafka-python
>       Description:   Confluent's Kafka Python Client
>       License:       Apache-2.0
>
> Is this correct ?
>
>
>>
>>> By the way what is the link between openstack packages  and
>>> dev-python/confluent-kafka ?
>>>
>>
>> confluent-kafka is a test dependency
>>
>
BTW now confluent-kafka::guru is also available for python3.9

>

[-- Attachment #2: Type: text/html, Size: 7570 bytes --]