[gentoo-user] Gentoo hardware database

[gentoo-user] Gentoo hardware database

[Andrey Ponomarenko]

Hi,

The Linux-Hardware.org database has been divided recently into a set of databases, one per each Linux distro. The one for Gentoo is available at:

https://linux-hardware.org/?d=Gentoo

Everyone can contribute to the database with the help of https://github.com/linuxhw/hw-probe (various packages for the tool are available: AppImage, Snap, Flatpak, Docker, ebuild http://gpo.zugaina.org/sys-apps/hw-probe, etc.). The tool is intended to simplify collecting of logs necessary for investigating hardware related problems. You need to execute only one simple command to collect all system logs at once:

    sudo hw-probe -all -upload

Hardware failures are highlighted in the collected logs (smartctl, dmesg, xorg.log). Also it's handy to search for particular hardware configurations in the community and review logs for errors to check operability of devices on board (for some devices this is done automatically by hw-probe — see statuses of devices in a probe).

Enjoy!

Re: [gentoo-user] Gentoo hardware database

[Andrew Udvare]

> On 2018-10-26, at 05:27, Andrey Ponomarenko <andrewponomarenko@yandex.ru> wrote:
> 
> Hi,
> 
> The Linux-Hardware.org database has been divided recently into a set of databases, one per each Linux distro. The one for Gentoo is available at:
> 
> https://linux-hardware.org/?d=Gentoo
> 
> Everyone can contribute to the database with the help of https://github.com/linuxhw/hw-probe (various packages for the tool are available: AppImage, Snap, Flatpak, Docker, ebuild http://gpo.zugaina.org/sys-apps/hw-probe, etc.). The tool is intended to simplify collecting of logs necessary for investigating hardware related problems. You need to execute only one simple command to collect all system logs at once:
> 
>    sudo hw-probe -all -upload
> 
> Hardware failures are highlighted in the collected logs (smartctl, dmesg, xorg.log). Also it's handy to search for particular hardware configurations in the community and review logs for errors to check operability of devices on board (for some devices this is done automatically by hw-probe — see statuses of devices in a probe).

I submitted my machines. What I find unusual is that one of my machines says 'failed' for the video card. On that machine, I have not installed Nvidia-drivers as it is not necessary (not using X or the card for anything except output since the motherboard does not have one built-in). Otherwise not sure how it detects failed vs works vs detected.

https://linux-hardware.org/?probe=9cb0ac857a

-- 
Andrew Udvare

Re: [gentoo-user] Gentoo hardware database

[Alexey Eschenko]

[-- Attachment #1: Type: text/html, Size: 1707 bytes --]

Re: [gentoo-user] Gentoo hardware database

[Dale]

Alexey Eschenko wrote:
> Is there any way to disable sending some parts of the collected data? 
> I've seen some of the last probes and found that there may be some
> potentially sensitive data.
> I don't mind to share my configuration with community but I don't want
> to share some logs, mountpoint data and same other info.
>


I'd like to remove a few things myself.  Some things such as file system
mount points and such gives clues as to what they contain.  I noticed a
couple other things I'd rather not include.

I noticed it builds a directory inside /root/HW_PROBE/LATEST/.  I used
the command hw-probe-1.4-129-x86_64.AppImage -all but left off the
upload part.  It collected the info but didn't send it yet.  I wonder,
can we delete the info from the directory it created and then leave off
-all but put -upload and it send only what we didn't delete.  In other
words, build the files, remove what we don't want sent and then send
what is left.  Do it in three parts instead of one.

Anyone know if that works?  Anyone who doesn't care what they send mind
testing it for us who want to leave out some small amounts of data? 

Thanks.

Dale

:-)  :-) 

Re: [gentoo-user] Gentoo hardware database

[Andrey Ponomarenko]

[-- Attachment #1: Type: text/html, Size: 2500 bytes --]

Re: [gentoo-user] Gentoo hardware database

[Andrey Ponomarenko]

27.10.2018, 02:18, "Dale" <rdalek1967@gmail.com>:
> Alexey Eschenko wrote:
>>  Is there any way to disable sending some parts of the collected data?
>>  I've seen some of the last probes and found that there may be some
>>  potentially sensitive data.
>>  I don't mind to share my configuration with community but I don't want
>>  to share some logs, mountpoint data and same other info.
>
> I'd like to remove a few things myself.  Some things such as file system
> mount points and such gives clues as to what they contain.  I noticed a
> couple other things I'd rather not include.
>
> I noticed it builds a directory inside /root/HW_PROBE/LATEST/.  I used
> the command hw-probe-1.4-129-x86_64.AppImage -all but left off the
> upload part.  It collected the info but didn't send it yet.  I wonder,
> can we delete the info from the directory it created and then leave off
> -all but put -upload and it send only what we didn't delete.  In other
> words, build the files, remove what we don't want sent and then send
> what is left.  Do it in three parts instead of one.
>
> Anyone know if that works?  Anyone who doesn't care what they send mind
> testing it for us who want to leave out some small amounts of data?
>
> Thanks.
>
> Dale
>
> :-)  :-)

Hi Dale,

Please use --log-level=minimal option to collect minimal info. Please let me know if it still contains some unwanted info in this minimal mode.

I'll patch the tool to collect less info by default in 1.5 (you'll need to explicitly set --log-level=maximal to collect mountpoints).

Thanks a lot!

Re: [gentoo-user] Gentoo hardware database

[Dale]

Andrey Ponomarenko wrote:
> 27.10.2018, 02:18, "Dale" <rdalek1967@gmail.com>:
>> Alexey Eschenko wrote:
>>>  Is there any way to disable sending some parts of the collected data?
>>>  I've seen some of the last probes and found that there may be some
>>>  potentially sensitive data.
>>>  I don't mind to share my configuration with community but I don't want
>>>  to share some logs, mountpoint data and same other info.
>> I'd like to remove a few things myself.  Some things such as file system
>> mount points and such gives clues as to what they contain.  I noticed a
>> couple other things I'd rather not include.
>>
>> I noticed it builds a directory inside /root/HW_PROBE/LATEST/.  I used
>> the command hw-probe-1.4-129-x86_64.AppImage -all but left off the
>> upload part.  It collected the info but didn't send it yet.  I wonder,
>> can we delete the info from the directory it created and then leave off
>> -all but put -upload and it send only what we didn't delete.  In other
>> words, build the files, remove what we don't want sent and then send
>> what is left.  Do it in three parts instead of one.
>>
>> Anyone know if that works?  Anyone who doesn't care what they send mind
>> testing it for us who want to leave out some small amounts of data?
>>
>> Thanks.
>>
>> Dale
>>
>> :-)  :-)
> Hi Dale,
>
> Please use --log-level=minimal option to collect minimal info. Please let me know if it still contains some unwanted info in this minimal mode.
>
> I'll patch the tool to collect less info by default in 1.5 (you'll need to explicitly set --log-level=maximal to collect mountpoints).
>
> Thanks a lot!
>
>


I saw the other post and tried it without the upload option.  It still
causes me some concern.  What I'd rather do, instead of you having a
unique setting for myself and others with different issues, just be able
to remove what we don't want included and then upload the data that
remains. That would be the easiest by far option for you and other
users.  If it will work that way, you won't have to change anything plus
others will run up on this and know how to do it that way.  It also
means that others can adjust based on their own set of concerns which
may be different than mine. 

It did help with minimal but some things it didn't include, I was fine
with sending but some things still remain that I don't.  If I remove
other options and only pass -upload, will it only send the data in
/root/HW_PROBE/LATEST/ or does it rebuild the file list again and then
send? 

Dale

:-)  :-) 

Re: [gentoo-user] Gentoo hardware database

[Andrey Ponomarenko]

27.10.2018, 17:56, "Dale" <rdalek1967@gmail.com>:
> Andrey Ponomarenko wrote:
>>  27.10.2018, 02:18, "Dale" <rdalek1967@gmail.com>:
>>>  Alexey Eschenko wrote:
>>>>   Is there any way to disable sending some parts of the collected data?
>>>>   I've seen some of the last probes and found that there may be some
>>>>   potentially sensitive data.
>>>>   I don't mind to share my configuration with community but I don't want
>>>>   to share some logs, mountpoint data and same other info.
>>>  I'd like to remove a few things myself.  Some things such as file system
>>>  mount points and such gives clues as to what they contain.  I noticed a
>>>  couple other things I'd rather not include.
>>>
>>>  I noticed it builds a directory inside /root/HW_PROBE/LATEST/.  I used
>>>  the command hw-probe-1.4-129-x86_64.AppImage -all but left off the
>>>  upload part.  It collected the info but didn't send it yet.  I wonder,
>>>  can we delete the info from the directory it created and then leave off
>>>  -all but put -upload and it send only what we didn't delete.  In other
>>>  words, build the files, remove what we don't want sent and then send
>>>  what is left.  Do it in three parts instead of one.
>>>
>>>  Anyone know if that works?  Anyone who doesn't care what they send mind
>>>  testing it for us who want to leave out some small amounts of data?
>>>
>>>  Thanks.
>>>
>>>  Dale
>>>
>>>  :-)  :-)
>>  Hi Dale,
>>
>>  Please use --log-level=minimal option to collect minimal info. Please let me know if it still contains some unwanted info in this minimal mode.
>>
>>  I'll patch the tool to collect less info by default in 1.5 (you'll need to explicitly set --log-level=maximal to collect mountpoints).
>>
>>  Thanks a lot!
>
> I saw the other post and tried it without the upload option.  It still
> causes me some concern.  What I'd rather do, instead of you having a
> unique setting for myself and others with different issues, just be able
> to remove what we don't want included and then upload the data that
> remains. That would be the easiest by far option for you and other
> users.  If it will work that way, you won't have to change anything plus
> others will run up on this and know how to do it that way.  It also
> means that others can adjust based on their own set of concerns which
> may be different than mine.
>
> It did help with minimal but some things it didn't include, I was fine
> with sending but some things still remain that I don't.  If I remove
> other options and only pass -upload, will it only send the data in
> /root/HW_PROBE/LATEST/ or does it rebuild the file list again and then
> send?
>
> Dale
>
> :-)  :-)

It will send content of /root/HW_PROBE/LATEST/ only. If you remove some file from this directory then it will not be sent until you collect it again by -all option.

But I think it's better to patch upstream code or add some option that will satisfy your needs to make the tool perform better by default w/o the need to write a wrapper script.

What unwanted files still remain in minimal mode?

Thank you.

Re: [gentoo-user] Gentoo hardware database

[Alexey Eschenko]

[-- Attachment #1.1: Type: text/plain, Size: 3823 bytes --]

It would probably be better to add "--no-*" options for each probe
section. For example:

--no-fstab
--no-lsblk
--no-xorg-conf
--no-xorg-log
--no-dmesg

And to have the page in the hw-probe wiki where these sections (and
disable parameters) are documented. And then link to this page could be
added to the Privacy section in the README.md.

So in the result each user will be able to determine which data he want
to share without modifying probe files.

On 10/29/18 9:20 AM, Andrey Ponomarenko wrote:
>
> 27.10.2018, 17:56, "Dale" <rdalek1967@gmail.com>:
>> Andrey Ponomarenko wrote:
>>>  27.10.2018, 02:18, "Dale" <rdalek1967@gmail.com>:
>>>>  Alexey Eschenko wrote:
>>>>>   Is there any way to disable sending some parts of the collected data?
>>>>>   I've seen some of the last probes and found that there may be some
>>>>>   potentially sensitive data.
>>>>>   I don't mind to share my configuration with community but I don't want
>>>>>   to share some logs, mountpoint data and same other info.
>>>>  I'd like to remove a few things myself.  Some things such as file system
>>>>  mount points and such gives clues as to what they contain.  I noticed a
>>>>  couple other things I'd rather not include.
>>>>
>>>>  I noticed it builds a directory inside /root/HW_PROBE/LATEST/.  I used
>>>>  the command hw-probe-1.4-129-x86_64.AppImage -all but left off the
>>>>  upload part.  It collected the info but didn't send it yet.  I wonder,
>>>>  can we delete the info from the directory it created and then leave off
>>>>  -all but put -upload and it send only what we didn't delete.  In other
>>>>  words, build the files, remove what we don't want sent and then send
>>>>  what is left.  Do it in three parts instead of one.
>>>>
>>>>  Anyone know if that works?  Anyone who doesn't care what they send mind
>>>>  testing it for us who want to leave out some small amounts of data?
>>>>
>>>>  Thanks.
>>>>
>>>>  Dale
>>>>
>>>>  :-)  :-)
>>>  Hi Dale,
>>>
>>>  Please use --log-level=minimal option to collect minimal info. Please let me know if it still contains some unwanted info in this minimal mode.
>>>
>>>  I'll patch the tool to collect less info by default in 1.5 (you'll need to explicitly set --log-level=maximal to collect mountpoints).
>>>
>>>  Thanks a lot!
>> I saw the other post and tried it without the upload option.  It still
>> causes me some concern.  What I'd rather do, instead of you having a
>> unique setting for myself and others with different issues, just be able
>> to remove what we don't want included and then upload the data that
>> remains. That would be the easiest by far option for you and other
>> users.  If it will work that way, you won't have to change anything plus
>> others will run up on this and know how to do it that way.  It also
>> means that others can adjust based on their own set of concerns which
>> may be different than mine.
>>
>> It did help with minimal but some things it didn't include, I was fine
>> with sending but some things still remain that I don't.  If I remove
>> other options and only pass -upload, will it only send the data in
>> /root/HW_PROBE/LATEST/ or does it rebuild the file list again and then
>> send?
>>
>> Dale
>>
>> :-)  :-)
> It will send content of /root/HW_PROBE/LATEST/ only. If you remove some file from this directory then it will not be sent until you collect it again by -all option.
>
> But I think it's better to patch upstream code or add some option that will satisfy your needs to make the tool perform better by default w/o the need to write a wrapper script.
>
> What unwanted files still remain in minimal mode?
>
> Thank you.
>
-- 
Kind regards,
Alexey Eschenko
https://skobk.in/



[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] Gentoo hardware database

[Dale]

Alexey Eschenko wrote:
> It would probably be better to add "--no-*" options for each probe
> section. For example:
>
> --no-fstab
> --no-lsblk
> --no-xorg-conf
> --no-xorg-log
> --no-dmesg
>
> And to have the page in the hw-probe wiki where these sections (and
> disable parameters) are documented. And then link to this page could be
> added to the Privacy section in the README.md.
>
> So in the result each user will be able to determine which data he want
> to share without modifying probe files.
>
>


I agree.  You have two items in your list that concern me but the rest
are OK.  Thing is, someone else may have a different list and it could
continue for others.  The list could be exhausting before to long. 

Your way tho makes it so that one can use the options needed for their
case.  Maybe even on a specific system at that. 

Still, deleting the files before uploading could also be documented as
well. 

Dale

:-)  :-)