[gentoo-soc] New gentoo packages -- report #5

[gentoo-soc] New gentoo packages -- report #5

[Slava Bacherikov]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello all.

My project task is creating new version of packages.gentoo.org site.
You could find it on
http://git.overlays.gentoo.org/gitweb/?p=proj/gentoo-packages.git;a=summary
or on https://github.com/bacher09/gentoo-packages
If you want to submit feature request you may do this by assign issue on
github to me.

Last week I worked on views. I write many views, that has ability filter
some objects by various params. I also spend time for profiling views,
and optimizing some of them with more efective database access. For some
of this cases I use django-prefetch module with have more advanced
prefetch_related method.  I also spend time for bug fixing in existing code.

Plans for the this week:
I want more extend views and write some new.
I'm gonna write some documentation.

- -- 
Slava Bacherikov <slava@bacherikov.org.ua>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJP8ZwSAAoJEGjUsUT09EyzDmUP/36kkawgIneKEWOy5XN80RdF
MOL5too5TwYN9H423GctPYHvuGBK10BtgHLAGqNR4pZEEy3KGoSH4xpwLa/t7l02
CvtRanqildQzULptCLT6F3PkgLCix1kIVi0ohufVNQ/6kfkQvLJCdb77G/cMAEhd
2GrIlKCxWOKBfTgP7mgDFUnFnXZhzsDV37k7YbuAzLQI2cfiHSrIfFesl7C8jqL4
Tbk2n5+KBb/FhOV10/4OJahwocs+W9Zt6/6/wZ35wrFpZVomFmAmGN1XPubQh1Sp
rY9SoZ5XVVltmcgRgLDz6NXXKYro/8FkR15jF+zrI1rA6+xmJN+6hmGMpNGMsneq
6iprJHCLaTmADacFrdtxyOY5yi5uNuPyk+eJ8buZHA3l+XZIFJU6wPt+s1XihyFf
ERySP8y4wpgA22x/HnlbJ3Y5czaSxb4l/y1SDJHGTL3x7wAprRGLAmTECuS8Mq4K
WCFAWiUi4L3yRDiCp9EiXs99gOmfx0GXTHVuO37bcRSMbQpxvtoZEnBTe0l45nO5
jMnJwKLMTt4756kNr5FJ8nOhfwgRRblt2u3A12ZMnMh8HyqJeUrSYSh5G3zLJP0X
7DsDjLlDhVa4tWe6Zz8LQ6dBtEs1yI5cNpyXqf1jsX/f38LJGnIlk5I4yH18otsa
Z5hWFn9ZgOIS/xc7BiDt
=tnNj
-----END PGP SIGNATURE-----

[gentoo-soc] New gentoo packages -- report #5

[Slava Bacherikov]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello all.

My project task is creating new version of packages.gentoo.org site.
You could find it on
http://git.overlays.gentoo.org/gitweb/?p=proj/gentoo-packages.git;a=summary
or on https://github.com/bacher09/gentoo-packages
If you want to submit feature request you may do this by assign issue on
github to me.

Last week I worked on improving  collection information and  view. I've
added ability to get and store additional information about the overlay,
but came up  against a small problem. Name of overlay could be not equal
to name in repo_name. For example haskell overlay in the repo_name file
has name gentoo-haskell. I partially solved this problem, now if it
could not find equal overlay name it tries add or delete 'gentoo-' prefix.

I also developed a backends mechanism for  scan - now it can collect 
information through portage or pkgcore, backend could be select the
settings file. Also implement another scaning backend is very easy, just
need implement special interface.

I also worked on the designs and the general improvement of the code.

Plans for the this week:
I'm gonna document my classes
I also plan work on views, layout and scanning tool.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJP6GcZAAoJEGjUsUT09EyzKSQP/1Fj/caHv2LEmTN+UmnSnCd+
dOl4723IKFA1UDUOmLGsmWbUCRy4ca80U2u4C+kqifnF7VzMW+gBewP5OYw4i2lF
luKIzXKaPcM/Gj5Jrh4OyTsxO+XbVqwE2Nz0BKLru7ypSQz9CfTnrrm2bP9WbsCa
6gDgd2+XvCpiYvjL/zeGszEUzaPD92IJygy8ky2YucBy92uzpJnTKyaR4JCqZkI4
lw/zTyW14xGn/aUlKpgzK8rsc/YO6NJTO5jSd/k7QZxHX5mUze9YUJmGmqkltU2v
x09AjDfbzuGy7wjaedI58RuDoRVFCz66kHECNErKPxALPSRMQJ0APQkrJ8xtIB2o
NRHsGUzqdltXsgusiEJUFRCOBJpkcccRZYG8n8DSw+mSZzpLSaYcZqP5cya6/x1v
jpBV+6132fTZixJN3cFa+pfPh4cya2iGrNnRmBCwoP+4jEyTCJYdJ1rjnVg/AKvw
ONtHCY7Kvpn5SqD41qq9Zl7ypgcLPAkkxAWi9/JoqZaKwaBK05Alq0OSshGMNTYg
CY0YYSyHaoDbcq7bF5068avCjqFiDkIpdnYhTvwYiPIRFC6eJNu6CYRDO+O/gt6b
7211wlK+4KcbXX36CFLcXCgfGvR3s/mZTTmFP2RmXhlxlGoR1+9VMnqoSV/SLVyi
NZm5pY32PivSi9LRE0xw
=3++n
-----END PGP SIGNATURE-----

Re: [gentoo-soc] New gentoo packages -- report #5

[Brian Dolbec]

[-- Attachment #1: Type: text/plain, Size: 4047 bytes --]

On Mon, 2012-06-25 at 16:26 +0300, Slava Bacherikov wrote:
> Hello all.
> 
> My project task is creating new version of packages.gentoo.org site.
> You could find it on
> http://git.overlays.gentoo.org/gitweb/?p=proj/gentoo-packages.git;a=summary
> or on https://github.com/bacher09/gentoo-packages
> If you want to submit feature request you may do this by assign issue on
> github to me.
> 
> Last week I worked on improving  collection information and  view. I've
> added ability to get and store additional information about the overlay,
> but came up  against a small problem. Name of overlay could be not equal
> to name in repo_name. For example haskell overlay in the repo_name file
> has name gentoo-haskell.


>  I partially solved this problem, now if it
> could not find equal overlay name it tries add or delete 'gentoo-' prefix.
> 
Sorry, I didn't get the irc channel your using added into my irc
client's autojoin.  But I have been in #-soc...


I ran into this same problem with layman.  It was adding the news
reporting to layman where I had the problem.  Since, layman does not do
the news reporting directly.  I ran some code to get the correct
repo_name from portage. There are some nice convienience functions which
I had implemented in portage a few years back (saved doing it in
porthole).  Then have portage report any new news items in the
overlay(s).  Pkgcore does not yet have the news reporting feature.

Check layman/api.py  

 544    def update_news(self, repos=None):
[snip]

 553                     # get the actual repo_name from portage
 554                     # because it may be different than layman's name for it
 555                     repo_names = []
 556                     for repo in repos:
 557                         ovl = self._get_installed_db().select(repo)
 558                         ovl_path = os.path.join(ovl.config['storage'], repo)
 559                         repo_names.append(portdb.getRepositoryName(ovl_path))
 560                     self.output.debug("LaymanAPI: update_news(); repo_names = "
 561                         + str(repo_names), 4)
 562                     news_counts = count_unread_news(portdb, vardb, repo_names)
 563                     display_news_notifications(news_counts)
...

Also note that pkgcore has both the repo_name and path info available,
although it does not have convienience funtions to get the other, given
one.  Here is how we are doing it in porthole's pkgcore backend.


    def get_overlay_name(self, ovl):
 541         #debug.dprint("PKGCORE.lib: get_overlay_name(); ovl = " +
ovl)
 542         for repo in self.settings.tree:
 543             try:
 544                 if repo.location == ovl:
 545                     return repo.repo_id
 546             except AttributeError:
 547                 continue
 548         return ""


Also if your looking for more pkgcore api's here's the link to the
dev_api branch where the backend porting work has been going on.

http://porthole.git.sourceforge.net/git/gitweb.cgi?p=porthole/porthole;a=tree;f=pmbackends;hb=refs/heads/dev_api

you can look thru the pkgcore and portage sub-pkgs.  Bare in mind that
some things are in flux, more in the portage backend in order to keep
things in line with the pkgcore backend.

I just ask that if you find out how to do something in pkgcore that you
see has not yet been ported in porthole's pkgcore backend.  To please
tell me :-) so I can implement it. 

> I also developed a backends mechanism for  scan - now it can collect 
> information through portage or pkgcore, backend could be select the
> settings file. Also implement another scaning backend is very easy, just
> need implement special interface.

good :-)

> 
> I also worked on the designs and the general improvement of the code.
> 
> Plans for the this week:
> I'm gonna document my classes
> I also plan work on views, layout and scanning tool.
> 


-- 
Brian Dolbec <dolsen@gentoo.org>

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 490 bytes --]