public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
* [gentoo-dev] euscan GSoC project - requesting feedback
@ 2012-06-27  7:51 Federico "fox" Scrinzi
  2012-06-27  8:00 ` Dirkjan Ochtman
                   ` (6 more replies)
  0 siblings, 7 replies; 20+ messages in thread
From: Federico "fox" Scrinzi @ 2012-06-27  7:51 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 1370 bytes --]

Hi everybody!

I'm working on a GSoC project for enhancing Euscan
(http://euscan.iksaif.net/). Euscan allows to check if a given
package/ebuild has new upstream versions or not. It uses different
heuristic to scan upstream and grab new versions and related urls.
Euscan has a web interface for surfing data but for now is only possible
to see the scan results per package/category/herd/maintainers/overlay.
We're working now on the possibility to register and provide a cool
dashboard for maintainers, so that they can easily keep an eye on the
upstream versions of the packages they maintain.

The main question is: what would you like to have on this dashboard?
Currently (in the development version) there's the possibility to login
and watch/unwatch packages/categories/herds/... and see the watched
stuff in the account dashboard. We're planning on implementing a
weekly(?) custom newsletter based on the packages you're watching, which
features would you like?

The project repo for the GSoC is here: https://github.com/volpino/euscan

Thanks!

-- 
f.

  "Always code as if the guy who ends up maintaining your code will be a
   violent psychopath who knows where you live."
  (Martin Golding)

()  ascii ribbon campaign - against html e-mail
/\  www.asciiribbon.org   - against proprietary attachments

http://about.me/fox91



[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 900 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
@ 2012-06-27  8:00 ` Dirkjan Ochtman
  2012-06-27  9:29   ` Michael Weber
  2012-06-27 14:33 ` Michał Górny
                   ` (5 subsequent siblings)
  6 siblings, 1 reply; 20+ messages in thread
From: Dirkjan Ochtman @ 2012-06-27  8:00 UTC (permalink / raw
  To: gentoo-dev

On Wed, Jun 27, 2012 at 9:51 AM, Federico "fox" Scrinzi <fox91@anche.no> wrote:
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?

- The ability to pick what overlays I care about
- Ignore alpha/beta versions if the current gentoo-x86 version is not alpha/beta
- Candidates for stabilization

Cheers,

Dirkjan



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  8:00 ` Dirkjan Ochtman
@ 2012-06-27  9:29   ` Michael Weber
  2012-06-28 15:33     ` Jeroen Roovers
  0 siblings, 1 reply; 20+ messages in thread
From: Michael Weber @ 2012-06-27  9:29 UTC (permalink / raw
  To: gentoo-dev

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 06/27/2012 10:00 AM, Dirkjan Ochtman wrote:
> On Wed, Jun 27, 2012 at 9:51 AM, Federico "fox" Scrinzi
> <fox91@anche.no> wrote:
>> The main question is: what would you like to have on this
>> dashboard? Currently (in the development version) there's the
>> possibility to login and watch/unwatch
>> packages/categories/herds/... and see the watched stuff in the
>> account dashboard. We're planning on implementing a weekly(?)
>> custom newsletter based on the packages you're watching, which 
>> features would you like?
> 
> - The ability to pick what overlays I care about - Ignore
> alpha/beta versions if the current gentoo-x86 version is not
> alpha/beta - Candidates for stabilization
> 

- - a request rescan button

- - a Report problem machanism.
   i.e. on http://euscan.iksaif.net/maintainers/48/ there's an
   inconsistency between both "upstream" and "version in gentoo"
   being 2012.2.0 but there's still a light red marker.

Great tool, thanks.

   Michael

- --
Gentoo Dev
http://xmw.de/


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iF4EAREIAAYFAk/q0o0ACgkQknrdDGLu8JB9/gD/QpQE9ezi3wMBKTgLfyT1oTEk
+4SxawZ5to7cdnI06q8BAJPdcxzuU+4AG05rTPzuPBfaDz4Xz7t7Xc9Bj+JsSN9W
=eV1X
-----END PGP SIGNATURE-----



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
  2012-06-27  8:00 ` Dirkjan Ochtman
@ 2012-06-27 14:33 ` Michał Górny
  2012-06-28  6:10   ` Federico "fox" Scrinzi
  2012-06-27 15:08 ` Andreas K. Huettel
                   ` (4 subsequent siblings)
  6 siblings, 1 reply; 20+ messages in thread
From: Michał Górny @ 2012-06-27 14:33 UTC (permalink / raw
  To: gentoo-dev; +Cc: fox91

[-- Attachment #1: Type: text/plain, Size: 743 bytes --]

On Wed, 27 Jun 2012 09:51:06 +0200
"Federico \"fox\" Scrinzi" <fox91@anche.no> wrote:

> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to
> login and watch/unwatch packages/categories/herds/... and see the
> watched stuff in the account dashboard. We're planning on
> implementing a weekly(?) custom newsletter based on the packages
> you're watching, which features would you like?

RSS/atom feeds as an alternative to the newsletter.

> The project repo for the GSoC is here:
> https://github.com/volpino/euscan

Is the development version running somewhere already so we could play
with it a bit?

-- 
Best regards,
Michał Górny

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 316 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
  2012-06-27  8:00 ` Dirkjan Ochtman
  2012-06-27 14:33 ` Michał Górny
@ 2012-06-27 15:08 ` Andreas K. Huettel
  2012-06-28  9:26 ` [gentoo-dev] " Michael Palimaka
                   ` (3 subsequent siblings)
  6 siblings, 0 replies; 20+ messages in thread
From: Andreas K. Huettel @ 2012-06-27 15:08 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 347 bytes --]

> The main question is: what would you like to have on this dashboard?

Not only the information whether ~arch is outdated, but also whether stable is 
outdated...

> custom newsletter based on the packages you're watching, 

please also as rss feed...

cheers, 
andreas

-- 
Andreas K. Huettel
Gentoo Linux developer
kde, sci, arm, tex, printing

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27 14:33 ` Michał Górny
@ 2012-06-28  6:10   ` Federico "fox" Scrinzi
  0 siblings, 0 replies; 20+ messages in thread
From: Federico "fox" Scrinzi @ 2012-06-28  6:10 UTC (permalink / raw
  To: gentoo-dev

On 27/06/2012 16:33, Michał Górny wrote:
> Is the development version running somewhere already so we could play
> with it a bit?

For now is not available unfortunately :( We'll try to set it up!


Thank you everybody for your feedback! The RSS feed is already
implemented globally, we'll just tweak it to have a per user feed.

I didn't considered the fact of separate stable and unstable but it's
indeed a really cool feature.

-- 
f.

  "Always code as if the guy who ends up maintaining your code will be a
   violent psychopath who knows where you live."
  (Martin Golding)





^ permalink raw reply	[flat|nested] 20+ messages in thread

* [gentoo-dev] Re: euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
                   ` (2 preceding siblings ...)
  2012-06-27 15:08 ` Andreas K. Huettel
@ 2012-06-28  9:26 ` Michael Palimaka
  2012-06-28 10:50   ` Andreas K. Huettel
  2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
                   ` (2 subsequent siblings)
  6 siblings, 1 reply; 20+ messages in thread
From: Michael Palimaka @ 2012-06-28  9:26 UTC (permalink / raw
  To: gentoo-dev

On 2012-06-27 17:51, Federico "fox" Scrinzi wrote:
> Hi everybody!
>
> I'm working on a GSoC project for enhancing Euscan
> (http://euscan.iksaif.net/). Euscan allows to check if a given
> package/ebuild has new upstream versions or not. It uses different
> heuristic to scan upstream and grab new versions and related urls.
> Euscan has a web interface for surfing data but for now is only possible
> to see the scan results per package/category/herd/maintainers/overlay.
> We're working now on the possibility to register and provide a cool
> dashboard for maintainers, so that they can easily keep an eye on the
> upstream versions of the packages they maintain.
>
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?
>
> The project repo for the GSoC is here: https://github.com/volpino/euscan
>
> Thanks!
>

Looking forward to seeing the improvements. :)

I'd like to see the information regarding current tree state updated 
more regularly than the full upstream scan. Especially when looking at 
the herd view, it can be hard to keep track of which bumps have already 
been completed.





^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] Re: euscan GSoC project - requesting feedback
  2012-06-28  9:26 ` [gentoo-dev] " Michael Palimaka
@ 2012-06-28 10:50   ` Andreas K. Huettel
  0 siblings, 0 replies; 20+ messages in thread
From: Andreas K. Huettel @ 2012-06-28 10:50 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 401 bytes --]

> I'd like to see the information regarding current tree state updated
> more regularly than the full upstream scan. Especially when looking at
> the herd view, it can be hard to keep track of which bumps have already
> been completed.

Good idea- it should be much cheaper to do the tree update than to re-scan 
upstream...

-- 
Andreas K. Huettel
Gentoo Linux developer
kde, sci, arm, tex, printing

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  9:29   ` Michael Weber
@ 2012-06-28 15:33     ` Jeroen Roovers
  0 siblings, 0 replies; 20+ messages in thread
From: Jeroen Roovers @ 2012-06-28 15:33 UTC (permalink / raw
  To: gentoo-dev

On Wed, 27 Jun 2012 11:29:49 +0200
Michael Weber <xmw@gentoo.org> wrote:

> - - a Report problem machanism.
>    i.e. on http://euscan.iksaif.net/maintainers/48/ there's an
>    inconsistency between both "upstream" and "version in gentoo"
>    being 2012.2.0 but there's still a light red marker.

And in the same spirit, a way to report when the scans generate false
positives in version matching.


     jer



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
                   ` (3 preceding siblings ...)
  2012-06-28  9:26 ` [gentoo-dev] " Michael Palimaka
@ 2012-06-29  2:07 ` Kent Fredric
  2012-06-29  5:32   ` [gentoo-dev] " Duncan
                     ` (2 more replies)
  2012-06-30 19:21 ` Andreas K. Huettel
       [not found] ` <4FFB4FF2.3030309@anche.no>
  6 siblings, 3 replies; 20+ messages in thread
From: Kent Fredric @ 2012-06-29  2:07 UTC (permalink / raw
  To: gentoo-dev

On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91@anche.no> wrote:
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?
>
> The project repo for the GSoC is here: https://github.com/volpino/euscan
>
> Thanks!
>

For the most part it seems to get upstream / portage versioning right,
but occasionally you get miss-matches for some reason.

It would be nice to allow to provide some mapping mechanism that
existed on the overlay itself to inform euscan how to map upstream
versions to downstream ones, but implementing that would be far too
complex I feel.

Instead, it would be nice to have a mechanism in the interface to set
a "Upstream version is" value for each package if euscan can't tell.

Ie:

http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/

Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these
are in fact the same version. So in 0.710.0 , it would be nice to be
able to set the upstream version manually to 0.71 so that euscan no
longer reported it as outdated.

http://euscan.iksaif.net/package/dev-perl/Authen-SASL-Cyrus-server/

0.13 == 0.13-serve

http://euscan.iksaif.net/package/dev-perl/Module-Extract-Namespaces/

0.140.200_rc == 0.14_0.2

http://euscan.iksaif.net/package/dev-perl/Math-BaseCnv/
http://euscan.iksaif.net/package/dev-perl/XML-Tidy/

1.8 == 1.8.B59BrZ
1.8 == 1.8.B2AMvd

( Upstream for those 2 packages have a versioning scheme tantamount to
intolerable cruelty.
https://rt.cpan.org/Public/Bug/Display.html?id=60275 )

http://euscan.iksaif.net/package/dev-perl/Perl-Critic-Moose/
0.999.2_rc == 0.999._002

http://euscan.iksaif.net/package/dev-perl/aliased/
0.300.100_rc == 0.30_0.1

http://euscan.iksaif.net/package/dev-perl/EV/
4.110.0  == 4.11


-- 
Kent

perl -e  "print substr( \"edrgmaM  SPA NOcomil.ic\\@tfrken\", \$_ * 3,
3 ) for ( 9,8,0,7,1,6,5,4,3,2 );"

http://kent-fredric.fox.geek.nz



^ permalink raw reply	[flat|nested] 20+ messages in thread

* [gentoo-dev] Re: euscan GSoC project - requesting feedback
  2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
@ 2012-06-29  5:32   ` Duncan
  2012-06-29 16:43     ` Kent Fredric
  2012-06-29  6:53   ` [gentoo-dev] " Michał Górny
  2012-06-29 12:09   ` Corentin Chary
  2 siblings, 1 reply; 20+ messages in thread
From: Duncan @ 2012-06-29  5:32 UTC (permalink / raw
  To: gentoo-dev

Kent Fredric posted on Fri, 29 Jun 2012 14:07:58 +1200 as excerpted:

> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
> 
> It would be nice to allow to provide some mapping mechanism that existed
> on the overlay itself to inform euscan how to map upstream versions to
> downstream ones, but implementing that would be far too complex I feel.
> 
> Instead, it would be nice to have a mechanism in the interface to set a
> "Upstream version is" value for each package if euscan can't tell.
> 
> Ie:
> 
> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
> 
> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these are
> in fact the same version. So in 0.710.0 , it would be nice to be able to
> set the upstream version manually to 0.71 so that euscan no longer
> reported it as outdated.

What about a simple variable that can be set in the ebuild?  Say for the 
above example something like:

EUSCAN_VERSION=0.71

I don't know how difficult that would be for euscan to pickup on, but 
since this would have no bearing on actual package behavior, only on 
euscan, I'd guess it shouldn't require going thru the formal PMS process, 
tho specifying it well enough to know whether it can be a function or 
must be a straight variable assignment, etc, as well as whether quotes 
are required or not, would be useful, and that's normally part of the PMS 
process so at least getting input from them would be useful.

Alternatively, define some formula that can be placed in the package's 
metadata.xml.  That's perhaps a better functionality match (we're talking 
about metadata, after all), but getting a formula that can deal with all 
the corner-cases is likely to be more difficult (and take longer) than 
simply specifying a variable to be defined for each ebuild that euscan 
can't immediately get correct.

-- 
Duncan - List replies preferred.   No HTML msgs.
"Every nonfree program has a lord, a master --
and if you use the program, he is your master."  Richard Stallman




^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
  2012-06-29  5:32   ` [gentoo-dev] " Duncan
@ 2012-06-29  6:53   ` Michał Górny
  2012-06-29 12:13     ` Corentin Chary
  2012-06-29 12:09   ` Corentin Chary
  2 siblings, 1 reply; 20+ messages in thread
From: Michał Górny @ 2012-06-29  6:53 UTC (permalink / raw
  To: gentoo-dev; +Cc: kentfredric

[-- Attachment #1: Type: text/plain, Size: 1736 bytes --]

On Fri, 29 Jun 2012 14:07:58 +1200
Kent Fredric <kentfredric@gmail.com> wrote:

> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91@anche.no> wrote:
> > The main question is: what would you like to have on this dashboard?
> > Currently (in the development version) there's the possibility to
> > login and watch/unwatch packages/categories/herds/... and see the
> > watched stuff in the account dashboard. We're planning on
> > implementing a weekly(?) custom newsletter based on the packages
> > you're watching, which features would you like?
> >
> > The project repo for the GSoC is here:
> > https://github.com/volpino/euscan
> >
> > Thanks!
> >
> 
> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
> 
> It would be nice to allow to provide some mapping mechanism that
> existed on the overlay itself to inform euscan how to map upstream
> versions to downstream ones, but implementing that would be far too
> complex I feel.
> 
> Instead, it would be nice to have a mechanism in the interface to set
> a "Upstream version is" value for each package if euscan can't tell.
> 
> Ie:
> 
> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
> 
> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these
> are in fact the same version. So in 0.710.0 , it would be nice to be
> able to set the upstream version manually to 0.71 so that euscan no
> longer reported it as outdated.

I think we could actually handle perl pretty easily. I believe euscan
will start using CPAN API to check the package versions, and we can
embed the normalization there.

-- 
Best regards,
Michał Górny

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 316 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
  2012-06-29  5:32   ` [gentoo-dev] " Duncan
  2012-06-29  6:53   ` [gentoo-dev] " Michał Górny
@ 2012-06-29 12:09   ` Corentin Chary
  2 siblings, 0 replies; 20+ messages in thread
From: Corentin Chary @ 2012-06-29 12:09 UTC (permalink / raw
  To: gentoo-dev

On Fri, Jun 29, 2012 at 4:07 AM, Kent Fredric <kentfredric@gmail.com> wrote:
> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91@anche.no> wrote:
>> The main question is: what would you like to have on this dashboard?
>> Currently (in the development version) there's the possibility to login
>> and watch/unwatch packages/categories/herds/... and see the watched
>> stuff in the account dashboard. We're planning on implementing a
>> weekly(?) custom newsletter based on the packages you're watching, which
>> features would you like?
>>
>> The project repo for the GSoC is here: https://github.com/volpino/euscan
>>
>> Thanks!
>>
>
> For the most part it seems to get upstream / portage versioning right,
> but occasionally you get miss-matches for some reason.
>
> It would be nice to allow to provide some mapping mechanism that
> existed on the overlay itself to inform euscan how to map upstream
> versions to downstream ones, but implementing that would be far too
> complex I feel.
>
> Instead, it would be nice to have a mechanism in the interface to set
> a "Upstream version is" value for each package if euscan can't tell.
>
> Ie:
>
> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
>
> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these
> are in fact the same version. So in 0.710.0 , it would be nice to be
> able to set the upstream version manually to 0.71 so that euscan no
> longer reported it as outdated.
>
> http://euscan.iksaif.net/package/dev-perl/Authen-SASL-Cyrus-server/
>
> 0.13 == 0.13-serve
>
> http://euscan.iksaif.net/package/dev-perl/Module-Extract-Namespaces/
>
> 0.140.200_rc == 0.14_0.2
>
> http://euscan.iksaif.net/package/dev-perl/Math-BaseCnv/
> http://euscan.iksaif.net/package/dev-perl/XML-Tidy/
>
> 1.8 == 1.8.B59BrZ
> 1.8 == 1.8.B2AMvd
>
> ( Upstream for those 2 packages have a versioning scheme tantamount to
> intolerable cruelty.
> https://rt.cpan.org/Public/Bug/Display.html?id=60275 )
>
> http://euscan.iksaif.net/package/dev-perl/Perl-Critic-Moose/
> 0.999.2_rc == 0.999._002
>
> http://euscan.iksaif.net/package/dev-perl/aliased/
> 0.300.100_rc == 0.30_0.1
>
> http://euscan.iksaif.net/package/dev-perl/EV/
> 4.110.0  == 4.11
>
>
> --
> Kent
>
> perl -e  "print substr( \"edrgmaM  SPA NOcomil.ic\\@tfrken\", \$_ * 3,
> 3 ) for ( 9,8,0,7,1,6,5,4,3,2 );"
>
> http://kent-fredric.fox.geek.nz
>

Something that could help with that: we plan to add something like
debian/watch in metadata.xml. This should allow to specify a regexp to
mangle versions (sed like syntax: /match/replace/). For some specific
packages, we also already have specific handlers (cpan, php, pypi,
etc...) which have specific version mangling functions.



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-29  6:53   ` [gentoo-dev] " Michał Górny
@ 2012-06-29 12:13     ` Corentin Chary
  2012-06-29 16:54       ` Kent Fredric
  0 siblings, 1 reply; 20+ messages in thread
From: Corentin Chary @ 2012-06-29 12:13 UTC (permalink / raw
  To: gentoo-dev; +Cc: kentfredric

On Fri, Jun 29, 2012 at 8:53 AM, Michał Górny <mgorny@gentoo.org> wrote:
> On Fri, 29 Jun 2012 14:07:58 +1200
> Kent Fredric <kentfredric@gmail.com> wrote:
>
>> On 27 June 2012 19:51, Federico "fox" Scrinzi <fox91@anche.no> wrote:
>> > The main question is: what would you like to have on this dashboard?
>> > Currently (in the development version) there's the possibility to
>> > login and watch/unwatch packages/categories/herds/... and see the
>> > watched stuff in the account dashboard. We're planning on
>> > implementing a weekly(?) custom newsletter based on the packages
>> > you're watching, which features would you like?
>> >
>> > The project repo for the GSoC is here:
>> > https://github.com/volpino/euscan
>> >
>> > Thanks!
>> >
>>
>> For the most part it seems to get upstream / portage versioning right,
>> but occasionally you get miss-matches for some reason.
>>
>> It would be nice to allow to provide some mapping mechanism that
>> existed on the overlay itself to inform euscan how to map upstream
>> versions to downstream ones, but implementing that would be far too
>> complex I feel.
>>
>> Instead, it would be nice to have a mechanism in the interface to set
>> a "Upstream version is" value for each package if euscan can't tell.
>>
>> Ie:
>>
>> http://euscan.iksaif.net/package/dev-perl/HTML-TreeBuilder-LibXML/
>>
>> Upstream is 0.71 , portage is ( normalised ) to 0.710.0 , and these
>> are in fact the same version. So in 0.710.0 , it would be nice to be
>> able to set the upstream version manually to 0.71 so that euscan no
>> longer reported it as outdated.
>
> I think we could actually handle perl pretty easily. I believe euscan
> will start using CPAN API to check the package versions, and we can
> embed the normalization there.

It's already the case:
https://github.com/iksaif/euscan/blob/master/pym/euscan/handlers/cpan.py
but my mangling functions are probably broken in some cases. If
somebody with a better knowledge of CPAN versionning scheme could fix
them it would be great !

Thanks,



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] Re: euscan GSoC project - requesting feedback
  2012-06-29  5:32   ` [gentoo-dev] " Duncan
@ 2012-06-29 16:43     ` Kent Fredric
  0 siblings, 0 replies; 20+ messages in thread
From: Kent Fredric @ 2012-06-29 16:43 UTC (permalink / raw
  To: gentoo-dev

On 29 June 2012 17:32, Duncan <1i5t5.duncan@cox.net> wrote:
>
> EUSCAN_VERSION=0.71
>
> I don't know how difficult that would be for euscan to pickup on, but
> since this would have no bearing on actual package behavior, only on
> euscan, I'd guess it shouldn't require going thru the formal PMS process,
> tho specifying it well enough to know whether it can be a function or
> must be a straight variable assignment, etc, as well as whether quotes
> are required or not, would be useful, and that's normally part of the PMS
> process so at least getting input from them would be useful.
>
> Alternatively, define some formula that can be placed in the package's
> metadata.xml.  That's perhaps a better functionality match (we're talking
> about metadata, after all), but getting a formula that can deal with all
> the corner-cases is likely to be more difficult (and take longer) than
> simply specifying a variable to be defined for each ebuild that euscan
> can't immediately get correct.

The problem is with this approach, some devs will want to set
EUSCAN_VERSION automagically using mangling $PV

As it is, we *already* have something equivalent to EUSCAN_VERSION for
things derived from perl-module.eclass, MODULE_VERSION=

Its not 1:1 identical to the intent of EUSCAN_VERSION, MODULE_VERSION
is only really required in the generation of SRC_URI , but because of
this, there is a loose MODULE_VERSION <-> distfile mapping, and a much
looser $PV <-> MODULE_VERSION association.

Sure, its fine for MODULE_VERSION to be made by mangling $PV, but the
problem is that the *reason* people mangle $PV to make MODULE_VERSION
is so they don't have to update MODULE_VERSION manually when bumping
the package.

Adding a non-bash non-$PV-manglable field EUSCAN_VERSION field will
possibly make manually incrementing this value a mandatory thing.

Not to mention, if it turns out to be "wrong" on the EUSCAN index,
some dev has to drop the change into the repository, do all the
manifest updating and commit signing and pushing it to CVS nonsense,
when really, its metadata only relevant to euscan, so its really in
the wrong place to start with.

Having it handled as an exception list on the euscan would be much
tidier, and the path from noticing the problem to solving the problem
becomes substantially shorter.



-- 
Kent

perl -e  "print substr( \"edrgmaM  SPA NOcomil.ic\\@tfrken\", \$_ * 3,
3 ) for ( 9,8,0,7,1,6,5,4,3,2 );"

http://kent-fredric.fox.geek.nz



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-29 12:13     ` Corentin Chary
@ 2012-06-29 16:54       ` Kent Fredric
  0 siblings, 0 replies; 20+ messages in thread
From: Kent Fredric @ 2012-06-29 16:54 UTC (permalink / raw
  To: Corentin Chary; +Cc: gentoo-dev

On 30 June 2012 00:13, Corentin Chary <iksaif@gentoo.org> wrote:

> It's already the case:
> https://github.com/iksaif/euscan/blob/master/pym/euscan/handlers/cpan.py
> but my mangling functions are probably broken in some cases. If
> somebody with a better knowledge of CPAN versionning scheme could fix
> them it would be great !
>
> Thanks,

The thing is there isn't a true versioning scheme for CPAN, just a
defacto one agreed upon by the community.  There are several
versioning schemes in employ, but the mechanics of each are rather
messy, and then  you have some lovely fellow like pip come along and
put garbage in their version, and we have to handle it manually.

For the most part though, people use "sensible" versions of a very few
basic varieties, and we downstream normalise these smattering of
varieties into a single form to make everything nice and tidy.  Its
still a work in progress migrating older ebuilds to our new
normalisation scheme, but its getting there.

And we do have a tool that will convert /most/ CPAN versions into
portage versions, which works as long as upstream are sane:

    dev-perl/Gentoo-PerlMod-Version

Which relies on another perl module 'version.pm' (
virtual/perl-version ) which handles most the real dirty work of
normalising things, and we just do a bit of post-processing of that to
make it nicer for us ( mostly stripping leading 0's in digit groups,
and mapping the upstream 'developer release' hints ( ie: -TRIAL  or
_01 components ) to the _rc  suffix.

If you wanted to you could call that script, or delve into the guts of
it and version.pm and try understand how it works, but you could be
there a while.

But we're unfortunately going to *always* need a way to correct
versions, because upstream occasionally produce bogus nonsense
versions that don't even make sense. ( ie: making versions go
backwards and expect it to work, but it does, because the cpan indexer
takes whatever was most recently uploaded ... or something like that.
)


-- 
Kent

perl -e  "print substr( \"edrgmaM  SPA NOcomil.ic\\@tfrken\", \$_ * 3,
3 ) for ( 9,8,0,7,1,6,5,4,3,2 );"

http://kent-fredric.fox.geek.nz



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
                   ` (4 preceding siblings ...)
  2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
@ 2012-06-30 19:21 ` Andreas K. Huettel
       [not found] ` <4FFB4FF2.3030309@anche.no>
  6 siblings, 0 replies; 20+ messages in thread
From: Andreas K. Huettel @ 2012-06-30 19:21 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: Text/Plain, Size: 575 bytes --]

Am Mittwoch, 27. Juni 2012, 09:51:06 schrieb Federico "fox" Scrinzi:
> The main question is: what would you like to have on this dashboard?

Here's another suggestion for euscan: right now we already have rss feeds, but 
they are far too verbose for me and clutter up my news list. I dont really 
need an item whenever something enters portage

How about a news feed that only contains "upstream" items?

Cheers, 
Andreas

-- 
Andreas K. Huettel
Gentoo Linux developer 
kde (team lead), sci, tex, arm, printing
dilfridge@gentoo.org
http://www.akhuettel.de/

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
       [not found] ` <4FFB4FF2.3030309@anche.no>
@ 2012-07-09 22:04   ` Agostino Sarubbo
  2012-07-10  1:28     ` Jeroen Roovers
  0 siblings, 1 reply; 20+ messages in thread
From: Agostino Sarubbo @ 2012-07-09 22:04 UTC (permalink / raw
  To: gentoo-dev, fox91

[-- Attachment #1: Type: text/plain, Size: 710 bytes --]

On Monday 09 July 2012 23:41:06 you wrote:
> The main question is: what would you like to have on this dashboard?
> Currently (in the development version) there's the possibility to login
> and watch/unwatch packages/categories/herds/... and see the watched
> stuff in the account dashboard. We're planning on implementing a
> weekly(?) custom newsletter based on the packages you're watching, which
> features would you like?

I talked with Federico on irc.

I proposed to have an 'integration' between euscan and pybugz.

In this manner everyone can file a version bump request via euscan.
What do you think about?
-- 
Agostino Sarubbo / ago -at- gentoo.org
Gentoo/AMD64 Arch Security Liaison
GPG: 0x7CD2DC5D

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-07-09 22:04   ` Agostino Sarubbo
@ 2012-07-10  1:28     ` Jeroen Roovers
  2012-07-10  1:39       ` Kent Fredric
  0 siblings, 1 reply; 20+ messages in thread
From: Jeroen Roovers @ 2012-07-10  1:28 UTC (permalink / raw
  To: gentoo-dev

On Tue, 10 Jul 2012 00:04:15 +0200
Agostino Sarubbo <ago@gentoo.org> wrote:

> I proposed to have an 'integration' between euscan and pybugz.

Sounds superficially like a giant security hole / spam gateway. What
kind of integration are we talking about?

> In this manner everyone can file a version bump request via euscan.
> What do you think about?

If the false positives go down significantly, we wouldn't need
interested users to "report" version bumps - you could automate that
all the way, and publish links to the bugs already reported.

But couldn't we more simply and securely implement publishing a
hyperlink from euscan's pages to the bugs.g.o form that fills out some
of the required information in advance? That way it's everybody's
personal bugzilla accounts that are responsible for the spam, and we
might more easily find duplicates.

Speaking of duplicates, the way subsequent version bump requests for
subsequent versions (in different SLOTs, mind you) are usually treated
now is that the later bugs are marked as duplicates of the former and
that the former bug's Summary is updated to show the currently best
version(s). If we're going to stick to that, we *definitely* need a way
to catch out duplicates.


     jer



^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [gentoo-dev] euscan GSoC project - requesting feedback
  2012-07-10  1:28     ` Jeroen Roovers
@ 2012-07-10  1:39       ` Kent Fredric
  0 siblings, 0 replies; 20+ messages in thread
From: Kent Fredric @ 2012-07-10  1:39 UTC (permalink / raw
  To: gentoo-dev

On 10 July 2012 13:28, Jeroen Roovers <jer@gentoo.org> wrote:
> On Tue, 10 Jul 2012 00:04:15 +0200
> Agostino Sarubbo <ago@gentoo.org> wrote:
>
>> I proposed to have an 'integration' between euscan and pybugz.
>
> Sounds superficially like a giant security hole / spam gateway. What
> kind of integration are we talking about?
>
>> In this manner everyone can file a version bump request via euscan.
>> What do you think about?
>
> If the false positives go down significantly, we wouldn't need
> interested users to "report" version bumps - you could automate that
> all the way, and publish links to the bugs already reported.
>
> But couldn't we more simply and securely implement publishing a
> hyperlink from euscan's pages to the bugs.g.o form that fills out some
> of the required information in advance? That way it's everybody's
> personal bugzilla accounts that are responsible for the spam, and we
> might more easily find duplicates.
>
> Speaking of duplicates, the way subsequent version bump requests for
> subsequent versions (in different SLOTs, mind you) are usually treated
> now is that the later bugs are marked as duplicates of the former and
> that the former bug's Summary is updated to show the currently best
> version(s). If we're going to stick to that, we *definitely* need a way
> to catch out duplicates.
>

This is verging on that oft requested thing that Gentoo could do with,
a sort of task queue for regular and repeated tasks that can be
described in one line and aren't worthy of a full bug.

  ie:  Version Bumps, stabilisation requests, generic repeated
transformations ( ie: make the metadata better, etc )

Things that if they really needed a full blown bug could be
cross-linked with bugzilla, but wouldn't need be the default option.

Though, thats really an entirely different discussion, I'm just
teasing the subject so ideas brew and the discussion eventually turns
up.

-- 
Kent

perl -e  "print substr( \"edrgmaM  SPA NOcomil.ic\\@tfrken\", \$_ * 3,
3 ) for ( 9,8,0,7,1,6,5,4,3,2 );"

http://kent-fredric.fox.geek.nz



^ permalink raw reply	[flat|nested] 20+ messages in thread

end of thread, other threads:[~2012-07-10  1:40 UTC | newest]

Thread overview: 20+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-06-27  7:51 [gentoo-dev] euscan GSoC project - requesting feedback Federico "fox" Scrinzi
2012-06-27  8:00 ` Dirkjan Ochtman
2012-06-27  9:29   ` Michael Weber
2012-06-28 15:33     ` Jeroen Roovers
2012-06-27 14:33 ` Michał Górny
2012-06-28  6:10   ` Federico "fox" Scrinzi
2012-06-27 15:08 ` Andreas K. Huettel
2012-06-28  9:26 ` [gentoo-dev] " Michael Palimaka
2012-06-28 10:50   ` Andreas K. Huettel
2012-06-29  2:07 ` [gentoo-dev] " Kent Fredric
2012-06-29  5:32   ` [gentoo-dev] " Duncan
2012-06-29 16:43     ` Kent Fredric
2012-06-29  6:53   ` [gentoo-dev] " Michał Górny
2012-06-29 12:13     ` Corentin Chary
2012-06-29 16:54       ` Kent Fredric
2012-06-29 12:09   ` Corentin Chary
2012-06-30 19:21 ` Andreas K. Huettel
     [not found] ` <4FFB4FF2.3030309@anche.no>
2012-07-09 22:04   ` Agostino Sarubbo
2012-07-10  1:28     ` Jeroen Roovers
2012-07-10  1:39       ` Kent Fredric

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox