public inbox for gentoo-portage-dev@lists.gentoo.org
 help / color / mirror / Atom feed
* [gentoo-portage-dev]
@ 2005-12-11 14:13 Niklas Lindblad
  0 siblings, 0 replies; 19+ messages in thread
From: Niklas Lindblad @ 2005-12-11 14:13 UTC (permalink / raw
  To: gentoo-portage-dev



-- 
gentoo-portage-dev@gentoo.org mailing list



^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
@ 2007-02-08  9:41 Шурмин Евгений Викторович
  0 siblings, 0 replies; 19+ messages in thread
From: Шурмин Евгений Викторович @ 2007-02-08  9:41 UTC (permalink / raw
  To: gentoo-portage-dev

[-- Attachment #1: Type: text/plain, Size: 5 bytes --]

 


[-- Attachment #2: Type: text/html, Size: 1087 bytes --]

^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
@ 2007-03-15  6:26 Шурмин Евгений Викторович
  0 siblings, 0 replies; 19+ messages in thread
From: Шурмин Евгений Викторович @ 2007-03-15  6:26 UTC (permalink / raw
  To: gentoo-portage-dev

[-- Attachment #1: Type: text/plain, Size: 127 bytes --]

 

 

С уважением, Шурмин Евгений.

Системный администратор банка OOO ИКБ "Стройсевзапбанк"

www.bankfamily.ru

 


[-- Attachment #2: Type: text/html, Size: 2243 bytes --]

^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
@ 2008-02-29  3:50 Tony
  2008-02-29 13:27 ` [gentoo-portage-dev] Andrew Gaffney
  0 siblings, 1 reply; 19+ messages in thread
From: Tony @ 2008-02-29  3:50 UTC (permalink / raw
  To: gentoo-portage-dev

Hi, I am new, but I think I found a problem in thr portage tree, dealing with texlive and tetex. I have a personal overlay, where I changed the dependency in the ebuild from "dev-text/tetex" to "virtual/latex-base." This solved it for the package.

I think that the packages will have to transition, because of these conflicts. Also, let me know if this is the right way to do this, and if it is, I suggest you do it soon. (It gets annoying)
 
Tony







      ____________________________________________________________________________________
Looking for last minute shopping deals?  
Find them fast with Yahoo! Search.  http://tools.search.yahoo.com/newsearch/category.php?category=shopping
-- 
gentoo-portage-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev]
  2008-02-29  3:50 [gentoo-portage-dev] Tony
@ 2008-02-29 13:27 ` Andrew Gaffney
  0 siblings, 0 replies; 19+ messages in thread
From: Andrew Gaffney @ 2008-02-29 13:27 UTC (permalink / raw
  To: gentoo-portage-dev

Tony wrote:
> Hi, I am new, but I think I found a problem in thr portage tree, dealing with texlive and tetex. I have a personal overlay, where I changed the dependency in the ebuild from "dev-text/tetex" to "virtual/latex-base." This solved it for the package.
> 
> I think that the packages will have to transition, because of these conflicts. Also, let me know if this is the right way to do this, and if it is, I suggest you do it soon. (It gets annoying)

Don't post without a subject. That's really annoying.

Also, this is completely off-topic for this list. Please file a bug at 
http://bugs.gentoo.org/

-- 
Andrew Gaffney                                 http://dev.gentoo.org/~agaffney/
Gentoo Linux Developer             Catalyst/Installer + x86 release coordinator
-- 
gentoo-portage-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache
@ 2014-01-01 22:14 SebastianLuther
  2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
  2014-01-01 22:46 ` [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
  0 siblings, 2 replies; 19+ messages in thread
From: SebastianLuther @ 2014-01-01 22:14 UTC (permalink / raw
  To: gentoo-portage-dev

From: Sebastian Luther <SebastianLuther@gmx.de>

xmatch returns _pkg_str instances these days. They require metadata
access, which cp_list doesn't have. That means that writing cp_list
results into the xmatch cache breaks xmatch users that expect _pkg_str
instances with full metadata.
---
 pym/portage/dbapi/porttree.py | 7 -------
 1 file changed, 7 deletions(-)

diff --git a/pym/portage/dbapi/porttree.py b/pym/portage/dbapi/porttree.py
index fc3fc03..62ac75c 100644
--- a/pym/portage/dbapi/porttree.py
+++ b/pym/portage/dbapi/porttree.py
@@ -740,12 +740,6 @@ class portdbapi(dbapi):
 
 		if self.frozen and mytree is None:
 			cachelist = self.xcache["cp-list"].get(mycp)
-			if cachelist is not None:
-				# Try to propagate this to the match-all cache here for
-				# repoman since he uses separate match-all caches for each
-				# profile (due to differences in _get_implicit_iuse).
-				self.xcache["match-all"][(mycp, mycp)] = cachelist
-				return cachelist[:]
 		mysplit = mycp.split("/")
 		invalid_category = mysplit[0] not in self._categories
 		d={}
@@ -796,7 +790,6 @@ class portdbapi(dbapi):
 		if self.frozen and mytree is None:
 			cachelist = mylist[:]
 			self.xcache["cp-list"][mycp] = cachelist
-			self.xcache["match-all"][(mycp, mycp)] = cachelist
 		return mylist
 
 	def freeze(self):
-- 
1.8.3.2



^ permalink raw reply related	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742)
  2014-01-01 22:14 [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
@ 2014-01-01 22:14 ` SebastianLuther
  2014-01-01 23:30   ` Brian Dolbec
                     ` (2 more replies)
  2014-01-01 22:46 ` [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
  1 sibling, 3 replies; 19+ messages in thread
From: SebastianLuther @ 2014-01-01 22:14 UTC (permalink / raw
  To: gentoo-portage-dev

From: Sebastian Luther <SebastianLuther@gmx.de>

---
 bin/repoman | 12 +++++++++++-
 1 file changed, 11 insertions(+), 1 deletion(-)

diff --git a/bin/repoman b/bin/repoman
index d1542e9..2a332a7 100755
--- a/bin/repoman
+++ b/bin/repoman
@@ -78,7 +78,7 @@ from portage.output import ConsoleStyleFile, StyleWriter
 from portage.util import writemsg_level
 from portage.util._argparse import ArgumentParser
 from portage.package.ebuild.digestgen import digestgen
-from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use
+from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use, eapi_has_slot_operator
 
 if sys.hexversion >= 0x3000000:
 	basestring = str
@@ -354,6 +354,7 @@ qahelp = {
 	"portage.internal": "The ebuild uses an internal Portage function or variable",
 	"repo.eapi.banned": "The ebuild uses an EAPI which is banned by the repository's metadata/layout.conf settings",
 	"repo.eapi.deprecated": "The ebuild uses an EAPI which is deprecated by the repository's metadata/layout.conf settings",
+	"slot.operator.missing": "The ebuild depends on package with several slots and/or sub slots without specifying a slot operator",
 	"virtual.oldstyle": "The ebuild PROVIDEs an old-style virtual (see GLEP 37)",
 	"virtual.suspect": "Ebuild contains a package that usually should be pulled via virtual/, not directly.",
 	"usage.obsolete": "The ebuild makes use of an obsolete construct",
@@ -399,6 +400,7 @@ qawarnings = set((
 "metadata.warning",
 "portage.internal",
 "repo.eapi.deprecated",
+"slot.operator.missing",
 "usage.obsolete",
 "upstream.workaround",
 "LIVEVCS.stable",
@@ -2070,6 +2072,14 @@ for x in effective_scanlist:
 							 " with a non-zero revision:" + \
 							 " '%s'") % (mytype, atom))
 
+					if not (atom.blocker or atom.slot or atom.slot_operator) and \
+						eapi_has_slot_operator(eapi):
+						child_slots = set((child.slot, child.sub_slot) for child in portdb.xmatch("match-all", atom))
+						if len(child_slots) > 1:
+							stats['slot.operator.missing'] += 1
+							fails['slot.operator.missing'].append(relative_path + \
+								": '%s' missing slot or slot operator" % atom)
+
 			type_list.extend([mytype] * (len(badsyntax) - len(type_list)))
 
 		for m, b in zip(type_list, badsyntax):
-- 
1.8.3.2



^ permalink raw reply related	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache
  2014-01-01 22:14 [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
  2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
@ 2014-01-01 22:46 ` SebastianLuther
  2014-01-01 23:29   ` Brian Dolbec
  1 sibling, 1 reply; 19+ messages in thread
From: SebastianLuther @ 2014-01-01 22:46 UTC (permalink / raw
  To: gentoo-portage-dev

From: Sebastian Luther <SebastianLuther@gmx.de>

xmatch returns _pkg_str instances these days. They require metadata
access, which cp_list doesn't have. That means that writing cp_list
results into the xmatch cache breaks xmatch users that expect _pkg_str
instances with full metadata.
---
 pym/portage/dbapi/porttree.py | 5 -----
 1 file changed, 5 deletions(-)

diff --git a/pym/portage/dbapi/porttree.py b/pym/portage/dbapi/porttree.py
index fc3fc03..53b9648 100644
--- a/pym/portage/dbapi/porttree.py
+++ b/pym/portage/dbapi/porttree.py
@@ -741,10 +741,6 @@ class portdbapi(dbapi):
 		if self.frozen and mytree is None:
 			cachelist = self.xcache["cp-list"].get(mycp)
 			if cachelist is not None:
-				# Try to propagate this to the match-all cache here for
-				# repoman since he uses separate match-all caches for each
-				# profile (due to differences in _get_implicit_iuse).
-				self.xcache["match-all"][(mycp, mycp)] = cachelist
 				return cachelist[:]
 		mysplit = mycp.split("/")
 		invalid_category = mysplit[0] not in self._categories
@@ -796,7 +792,6 @@ class portdbapi(dbapi):
 		if self.frozen and mytree is None:
 			cachelist = mylist[:]
 			self.xcache["cp-list"][mycp] = cachelist
-			self.xcache["match-all"][(mycp, mycp)] = cachelist
 		return mylist
 
 	def freeze(self):
-- 
1.8.3.2



^ permalink raw reply related	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache
  2014-01-01 22:46 ` [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
@ 2014-01-01 23:29   ` Brian Dolbec
  0 siblings, 0 replies; 19+ messages in thread
From: Brian Dolbec @ 2014-01-01 23:29 UTC (permalink / raw
  To: gentoo-portage-dev

[-- Attachment #1: Type: text/plain, Size: 1526 bytes --]

On Wed, 2014-01-01 at 23:46 +0100, SebastianLuther@gmx.de wrote:
> From: Sebastian Luther <SebastianLuther@gmx.de>
> 
> xmatch returns _pkg_str instances these days. They require metadata
> access, which cp_list doesn't have. That means that writing cp_list
> results into the xmatch cache breaks xmatch users that expect _pkg_str
> instances with full metadata.
> ---
>  pym/portage/dbapi/porttree.py | 5 -----
>  1 file changed, 5 deletions(-)
> 
> diff --git a/pym/portage/dbapi/porttree.py b/pym/portage/dbapi/porttree.py
> index fc3fc03..53b9648 100644
> --- a/pym/portage/dbapi/porttree.py
> +++ b/pym/portage/dbapi/porttree.py
> @@ -741,10 +741,6 @@ class portdbapi(dbapi):
>  		if self.frozen and mytree is None:
>  			cachelist = self.xcache["cp-list"].get(mycp)
>  			if cachelist is not None:
> -				# Try to propagate this to the match-all cache here for
> -				# repoman since he uses separate match-all caches for each
> -				# profile (due to differences in _get_implicit_iuse).
> -				self.xcache["match-all"][(mycp, mycp)] = cachelist
>  				return cachelist[:]
>  		mysplit = mycp.split("/")
>  		invalid_category = mysplit[0] not in self._categories
> @@ -796,7 +792,6 @@ class portdbapi(dbapi):
>  		if self.frozen and mytree is None:
>  			cachelist = mylist[:]
>  			self.xcache["cp-list"][mycp] = cachelist
> -			self.xcache["match-all"][(mycp, mycp)] = cachelist
>  		return mylist
>  
>  	def freeze(self):

Sounds correct to me.  Anyone object to committing this?

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 620 bytes --]

^ permalink raw reply	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742)
  2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
@ 2014-01-01 23:30   ` Brian Dolbec
  2014-01-02  8:50   ` [gentoo-portage-dev] " Ryan Hill
  2014-01-02  9:24   ` [gentoo-portage-dev] SebastianLuther
  2 siblings, 0 replies; 19+ messages in thread
From: Brian Dolbec @ 2014-01-01 23:30 UTC (permalink / raw
  To: gentoo-portage-dev

[-- Attachment #1: Type: text/plain, Size: 2495 bytes --]

On Wed, 2014-01-01 at 23:14 +0100, SebastianLuther@gmx.de wrote:
> From: Sebastian Luther <SebastianLuther@gmx.de>
> 
> ---
>  bin/repoman | 12 +++++++++++-
>  1 file changed, 11 insertions(+), 1 deletion(-)
> 
> diff --git a/bin/repoman b/bin/repoman
> index d1542e9..2a332a7 100755
> --- a/bin/repoman
> +++ b/bin/repoman
> @@ -78,7 +78,7 @@ from portage.output import ConsoleStyleFile, StyleWriter
>  from portage.util import writemsg_level
>  from portage.util._argparse import ArgumentParser
>  from portage.package.ebuild.digestgen import digestgen
> -from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use
> +from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use, eapi_has_slot_operator
>  
>  if sys.hexversion >= 0x3000000:
>  	basestring = str
> @@ -354,6 +354,7 @@ qahelp = {
>  	"portage.internal": "The ebuild uses an internal Portage function or variable",
>  	"repo.eapi.banned": "The ebuild uses an EAPI which is banned by the repository's metadata/layout.conf settings",
>  	"repo.eapi.deprecated": "The ebuild uses an EAPI which is deprecated by the repository's metadata/layout.conf settings",
> +	"slot.operator.missing": "The ebuild depends on package with several slots and/or sub slots without specifying a slot operator",
>  	"virtual.oldstyle": "The ebuild PROVIDEs an old-style virtual (see GLEP 37)",
>  	"virtual.suspect": "Ebuild contains a package that usually should be pulled via virtual/, not directly.",
>  	"usage.obsolete": "The ebuild makes use of an obsolete construct",
> @@ -399,6 +400,7 @@ qawarnings = set((
>  "metadata.warning",
>  "portage.internal",
>  "repo.eapi.deprecated",
> +"slot.operator.missing",
>  "usage.obsolete",
>  "upstream.workaround",
>  "LIVEVCS.stable",
> @@ -2070,6 +2072,14 @@ for x in effective_scanlist:
>  							 " with a non-zero revision:" + \
>  							 " '%s'") % (mytype, atom))
>  
> +					if not (atom.blocker or atom.slot or atom.slot_operator) and \
> +						eapi_has_slot_operator(eapi):
> +						child_slots = set((child.slot, child.sub_slot) for child in portdb.xmatch("match-all", atom))
> +						if len(child_slots) > 1:
> +							stats['slot.operator.missing'] += 1
> +							fails['slot.operator.missing'].append(relative_path + \
> +								": '%s' missing slot or slot operator" % atom)
> +
>  			type_list.extend([mytype] * (len(badsyntax) - len(type_list)))
>  
>  		for m, b in zip(type_list, badsyntax):

Looks good

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 620 bytes --]

^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev] Re: [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742)
  2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
  2014-01-01 23:30   ` Brian Dolbec
@ 2014-01-02  8:50   ` Ryan Hill
  2014-01-02  9:24   ` [gentoo-portage-dev] SebastianLuther
  2 siblings, 0 replies; 19+ messages in thread
From: Ryan Hill @ 2014-01-02  8:50 UTC (permalink / raw
  To: gentoo-portage-dev

[-- Attachment #1: Type: text/plain, Size: 366 bytes --]

On Wed,  1 Jan 2014 23:14:11 +0100
SebastianLuther@gmx.de wrote:

+	"slot.operator.missing": "The ebuild depends on package with several...
                                                       ^ a

-- 
Ryan Hill                        psn: dirtyepic_sk
   gcc-porting/toolchain/wxwidgets @ gentoo.org

47C3 6D62 4864 0E49 8E9E  7F92 ED38 BD49 957A 8463

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
  2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
  2014-01-01 23:30   ` Brian Dolbec
  2014-01-02  8:50   ` [gentoo-portage-dev] " Ryan Hill
@ 2014-01-02  9:24   ` SebastianLuther
  2014-01-02  9:24     ` [gentoo-portage-dev] [PATCH] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
  2 siblings, 1 reply; 19+ messages in thread
From: SebastianLuther @ 2014-01-02  9:24 UTC (permalink / raw
  To: gentoo-portage-dev

Changes:

* restrict check to runtime dependencies
* don't skip the check for atoms with slots, but only for slot+sub-slot
* fix typo found by Ryan



^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev] [PATCH] repoman: Add check for missing slot operators (bug 493742)
  2014-01-02  9:24   ` [gentoo-portage-dev] SebastianLuther
@ 2014-01-02  9:24     ` SebastianLuther
  0 siblings, 0 replies; 19+ messages in thread
From: SebastianLuther @ 2014-01-02  9:24 UTC (permalink / raw
  To: gentoo-portage-dev

From: Sebastian Luther <SebastianLuther@gmx.de>

---
 bin/repoman | 14 +++++++++++++-
 1 file changed, 13 insertions(+), 1 deletion(-)

diff --git a/bin/repoman b/bin/repoman
index d1542e9..cb1d620 100755
--- a/bin/repoman
+++ b/bin/repoman
@@ -78,7 +78,7 @@ from portage.output import ConsoleStyleFile, StyleWriter
 from portage.util import writemsg_level
 from portage.util._argparse import ArgumentParser
 from portage.package.ebuild.digestgen import digestgen
-from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use
+from portage.eapi import eapi_has_iuse_defaults, eapi_has_required_use, eapi_has_slot_operator
 
 if sys.hexversion >= 0x3000000:
 	basestring = str
@@ -354,6 +354,7 @@ qahelp = {
 	"portage.internal": "The ebuild uses an internal Portage function or variable",
 	"repo.eapi.banned": "The ebuild uses an EAPI which is banned by the repository's metadata/layout.conf settings",
 	"repo.eapi.deprecated": "The ebuild uses an EAPI which is deprecated by the repository's metadata/layout.conf settings",
+	"slot.operator.missing": "The ebuild depends on a package with several slots and/or sub slots without specifying a slot operator",
 	"virtual.oldstyle": "The ebuild PROVIDEs an old-style virtual (see GLEP 37)",
 	"virtual.suspect": "Ebuild contains a package that usually should be pulled via virtual/, not directly.",
 	"usage.obsolete": "The ebuild makes use of an obsolete construct",
@@ -399,6 +400,7 @@ qawarnings = set((
 "metadata.warning",
 "portage.internal",
 "repo.eapi.deprecated",
+"slot.operator.missing",
 "usage.obsolete",
 "upstream.workaround",
 "LIVEVCS.stable",
@@ -2070,6 +2072,16 @@ for x in effective_scanlist:
 							 " with a non-zero revision:" + \
 							 " '%s'") % (mytype, atom))
 
+					if runtime and not atom.blocker and not atom.slot_operator and \
+						eapi_has_slot_operator(eapi) and \
+						not (atom.slot and atom.sub_slot):
+						child_slots = set((child.slot, child.sub_slot) \
+							for child in portdb.xmatch("match-all", atom))
+						if len(child_slots) > 1:
+							stats['slot.operator.missing'] += 1
+							fails['slot.operator.missing'].append(relative_path + \
+								": '%s' in %s missing slot/sub-slot or slot operator" % (atom, mytype))
+
 			type_list.extend([mytype] * (len(badsyntax) - len(type_list)))
 
 		for m, b in zip(type_list, badsyntax):
-- 
1.8.3.2



^ permalink raw reply related	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
@ 2014-01-28 10:56 Alexander Berntsen
  2014-01-28 10:57 ` [gentoo-portage-dev] Alexander Berntsen
  0 siblings, 1 reply; 19+ messages in thread
From: Alexander Berntsen @ 2014-01-28 10:56 UTC (permalink / raw
  To: gentoo-dev+unsubscribe, gentoo-dev-announce+unsubscribe,
	gentoo-project+unsubscribe, gentoo-announce+unsubscribe,
	gentoo-portage-dev

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256


- -- 
Alexander
alexander@plaimi.net
http://plaimi.net/~alexander
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iF4EAREIAAYFAlLnjOMACgkQRtClrXBQc7UWQAD8CjdMTbWDlIUDL4NPG3ppY5TU
V+IIdrAsroAnNNaKq+QA/2q/MVyQmhOMjw2TUhWRkHHph8OiJ9UJxwPQTHeqb518
=6kSU
-----END PGP SIGNATURE-----


^ permalink raw reply	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev]
  2014-01-28 10:56 [gentoo-portage-dev] Alexander Berntsen
@ 2014-01-28 10:57 ` Alexander Berntsen
  0 siblings, 0 replies; 19+ messages in thread
From: Alexander Berntsen @ 2014-01-28 10:57 UTC (permalink / raw
  To: gentoo-dev+unsubscribe, gentoo-dev-announce+unsubscribe,
	gentoo-project+unsubscribe, gentoo-announce+unsubscribe,
	gentoo-portage-dev

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Ooops. Disregard. Am resubscribing with my go account.

- -- 
Alexander
alexander@plaimi.net
http://plaimi.net/~alexander
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iF4EAREIAAYFAlLnjR4ACgkQRtClrXBQc7XEZgEAkm5P1fvKPfqwKUOxzEWktbZn
4PVCz5Qvacedu3xKcM8A/2phDSlpffiOfRGD0VyUNtPvoOoI0hMvMYxLqhrhFlT0
=5jaI
-----END PGP SIGNATURE-----


^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
@ 2014-02-23  8:07 Brian Dolbec
  0 siblings, 0 replies; 19+ messages in thread
From: Brian Dolbec @ 2014-02-23  8:07 UTC (permalink / raw
  To: gentoo-portage-dev

As per bug 472104.  Add the emerge option --verbose-slot-rebuild to have 
the ability to turn off the option.  It is defaulted to "ON".
Second patch is some automatic whitespace cleanup my editor did while working
on this change. 


^ permalink raw reply	[flat|nested] 19+ messages in thread

* [gentoo-portage-dev]
  2014-10-18  3:28 [gentoo-portage-dev] [PATCH] emerge --search: use description index Zac Medico
@ 2014-11-01 22:46 ` Zac Medico
  2014-11-03 21:42   ` [gentoo-portage-dev] Brian Dolbec
  0 siblings, 1 reply; 19+ messages in thread
From: Zac Medico @ 2014-11-01 22:46 UTC (permalink / raw
  To: gentoo-portage-dev

In addition to indexed search, this patch series implements
stream-based incremental display of search results (fixing bug
#412471).

I'll be maintaining this patch series in the following branch:

	https://github.com/zmedico/portage/tree/bug_525718_stream

The old non-incremental version of this patch series is still
available here:

	https://github.com/zmedico/portage/tree/bug_525718



^ permalink raw reply	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev]
  2014-11-01 22:46 ` [gentoo-portage-dev] Zac Medico
@ 2014-11-03 21:42   ` Brian Dolbec
  2014-11-04  9:19     ` [gentoo-portage-dev] Zac Medico
  0 siblings, 1 reply; 19+ messages in thread
From: Brian Dolbec @ 2014-11-03 21:42 UTC (permalink / raw
  To: gentoo-portage-dev

On Sat,  1 Nov 2014 15:46:18 -0700
Zac Medico <zmedico@gentoo.org> wrote:

> In addition to indexed search, this patch series implements
> stream-based incremental display of search results (fixing bug
> #412471).
> 
> I'll be maintaining this patch series in the following branch:
> 
> 	https://github.com/zmedico/portage/tree/bug_525718_stream
> 
> The old non-incremental version of this patch series is still
> available here:
> 
> 	https://github.com/zmedico/portage/tree/bug_525718
> 
> 

Zac, while the code looks good, testing has showed a significant drop
in performance for a -s search while it is greatly improves for a -S
search.

big_daddy portage # time emerge -s porthole
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
  
[ Results for search key : porthole ]
Searching...    
*  app-portage/porthole
      Latest version available: 0.6.1-r3
      Latest version installed: 0.6.1-r3
      Size of files: 937 KiB
      Homepage:      http://porthole.sourceforge.net
      Description:   A GTK+-based frontend to Portage
      License:       GPL-2

[ Applications found : 1 ]


real	0m5.509s
user	0m5.181s
sys	0m0.321s
big_daddy portage # time /usr/bin/emerge -s porthole
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
Searching...    
[ Results for search key : porthole ]
[ Applications found : 1 ]

*  app-portage/porthole
      Latest version available: 0.6.1-r3
      Latest version installed: 0.6.1-r3
      Size of files: 937 KiB
      Homepage:      http://porthole.sourceforge.net
      Description:   A GTK+-based frontend to Portage
      License:       GPL-2


real	0m3.431s
user	0m3.024s
sys	0m0.401s
big_daddy portage # emerge --version
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
Portage 2.2.14_p28 (python 3.3.5-final-0, default/linux/amd64/13.0/desktop, gcc-4.8.3, glibc-2.19-r1, 3.16.1-gentoo x86_64)
big_daddy portage # /usr/bin/emerge --version
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
Portage 2.2.14 (python 3.3.5-final-0, default/linux/amd64/13.0/desktop, gcc-4.8.3, glibc-2.19-r1, 3.16.1-gentoo x86_64)
big_daddy portage # time esearch porthole
[ Results for search key : porthole ]
[ Applications found : 1 ]

*  app-portage/porthole
      Latest version available: 0.6.1-r3
      Latest version installed: 0.6.1-r3
      Size of downloaded files: 936 kB
      Homepage:    http://porthole.sourceforge.net
      Description: A GTK+-based frontend to Portage
      License:     GPL-2
 

real	0m0.189s
user	0m0.149s
sys	0m0.038s
big_daddy portage # 

========================

times for -S search

========================

big_daddy portage # time /usr/bin/emerge -S porthole
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
Searching...   / * ERROR: app-portage/c-layman-9999::gentoo-guis failed (depend phase):
 *   git.eclass could not be found by inherit()
 * 
 * Call stack:
 *              ebuild.sh, line 550:  Called source '/home/brian/Dev/git/gentoo-guis/app-portage/c-layman/c-layman-9999.ebuild'
 *   c-layman-9999.ebuild, line   9:  Called inherit 'git'
 *              ebuild.sh, line 257:  Called die
 * The specific snippet of code:
 *   		[[ -z ${location} ]] && die "${1}.eclass could not be found by inherit()"
 * 
 * If you need support, post the output of `emerge --info '=app-portage/c-layman-9999::gentoo-guis'`,
 * the complete build log and the output of `emerge -pqv '=app-portage/c-layman-9999::gentoo-guis'`.
 * Working directory: '/usr/lib64/python3.3/site-packages'
 * S: '/var/tmp/portage/app-portage/c-layman-9999/work/c-layman-9999'
emerge: search: aux_get() failed, skipping
 | * Manifest not found for '/home/brian/Dev/git/gentoo-guis/app-portage/ufed/ufed-9999.ebuild'
 | * ERROR: dev-vcs/git-bzr-9999::The-Pit failed (depend phase):
 *   git.eclass could not be found by inherit()
 * 
 * Call stack:
 *             ebuild.sh, line 550:  Called source '/usr/local/portage/dev-vcs/git-bzr/git-bzr-9999.ebuild'
 *   git-bzr-9999.ebuild, line   4:  Called inherit 'git'
 *             ebuild.sh, line 257:  Called die
 * The specific snippet of code:
 *   		[[ -z ${location} ]] && die "${1}.eclass could not be found by inherit()"
 * 
 * If you need support, post the output of `emerge --info '=dev-vcs/git-bzr-9999::The-Pit'`,
 * the complete build log and the output of `emerge -pqv '=dev-vcs/git-bzr-9999::The-Pit'`.
 * Working directory: '/usr/lib64/python3.3/site-packages'
 * S: '/var/tmp/portage/dev-vcs/git-bzr-9999/work/git-bzr-9999'
emerge: search: aux_get() failed, skipping
  
[ Results for search key : porthole ]
[ Applications found : 1 ]

*  app-portage/porthole
      Latest version available: 0.6.1-r3
      Latest version installed: 0.6.1-r3
      Size of files: 937 KiB
      Homepage:      http://porthole.sourceforge.net
      Description:   A GTK+-based frontend to Portage
      License:       GPL-2


real	1m15.121s
user	1m1.664s
sys	0m12.891s
big_daddy portage # time emerge -S porthole
!!! Repository 'vdr-devel' has sync-type attribute set to unsupported value: 'layman'
!!! Repository 'wtk' has sync-type attribute set to unsupported value: 'layman'
  
[ Results for search key : porthole ]
Searching...    
 * ERROR: app-portage/c-layman-9999::gentoo-guis failed (depend phase):
 *   git.eclass could not be found by inherit()
 * 
 * Call stack:
 *              ebuild.sh, line 575:  Called source '/home/brian/Dev/git/gentoo-guis/app-portage/c-layman/c-layman-9999.ebuild'
 *   c-layman-9999.ebuild, line   9:  Called inherit 'git'
 *              ebuild.sh, line 257:  Called die
 * The specific snippet of code:
 *   		[[ -z ${location} ]] && die "${1}.eclass could not be found by inherit()"
 * 
 * If you need support, post the output of `emerge --info '=app-portage/c-layman-9999::gentoo-guis'`,
 * the complete build log and the output of `emerge -pqv '=app-portage/c-layman-9999::gentoo-guis'`.
 * Working directory: '/home/brian/Dev/git/portage/pym'
 * S: '/var/tmp/portage/app-portage/c-layman-9999/work/c-layman-9999'
emerge: search: aux_get() failed, skipping
*  app-portage/porthole
      Latest version available: 0.6.1-r3
      Latest version installed: 0.6.1-r3
      Size of files: 937 KiB
      Homepage:      http://porthole.sourceforge.net
      Description:   A GTK+-based frontend to Portage
      License:       GPL-2

 * ERROR: dev-vcs/git-bzr-9999::The-Pit failed (depend phase):
 *   git.eclass could not be found by inherit()
 * 
 * Call stack:
 *             ebuild.sh, line 575:  Called source '/usr/local/portage/dev-vcs/git-bzr/git-bzr-9999.ebuild'
 *   git-bzr-9999.ebuild, line   4:  Called inherit 'git'
 *             ebuild.sh, line 257:  Called die
 * The specific snippet of code:
 *   		[[ -z ${location} ]] && die "${1}.eclass could not be found by inherit()"
 * 
 * If you need support, post the output of `emerge --info '=dev-vcs/git-bzr-9999::The-Pit'`,
 * the complete build log and the output of `emerge -pqv '=dev-vcs/git-bzr-9999::The-Pit'`.
 * Working directory: '/home/brian/Dev/git/portage/pym'
 * S: '/var/tmp/portage/dev-vcs/git-bzr-9999/work/git-bzr-9999'
emerge: search: aux_get() failed, skipping
[ Applications found : 1 ]


real	0m12.515s
user	0m11.795s
sys	0m0.660s
big_daddy portage # 

I know the above times are probably slowed by not having overlays indexed, but it is still a significant speedup.
esearch is only marginally slower doing a -S search than a regular pkg-name search, typically just over 0.2 seconds


The above was done with only the gentoo repo indexed, plus I need to clean out some old ebuilds in overlays.
But I was shocked to see the normal -s searches going from 3.4s to 5.5s with your new index.

Also I did not see a way to specify all repos to be index updated.  It is I believe a requirement of this new system.  Re-running is for each repo installed individually is something to be reserved for the new postsync() to do when it lands in master. 

-- 
Brian Dolbec <dolsen>



^ permalink raw reply	[flat|nested] 19+ messages in thread

* Re: [gentoo-portage-dev]
  2014-11-03 21:42   ` [gentoo-portage-dev] Brian Dolbec
@ 2014-11-04  9:19     ` Zac Medico
  0 siblings, 0 replies; 19+ messages in thread
From: Zac Medico @ 2014-11-04  9:19 UTC (permalink / raw
  To: gentoo-portage-dev

On 11/03/2014 01:42 PM, Brian Dolbec wrote:
> I know the above times are probably slowed by not having overlays indexed, but it is still a significant speedup.
> esearch is only marginally slower doing a -S search than a regular pkg-name search, typically just over 0.2 seconds
> 
> 
> The above was done with only the gentoo repo indexed, plus I need to clean out some old ebuilds in overlays.
> But I was shocked to see the normal -s searches going from 3.4s to 5.5s with your new index.


If you update now, performance should be much better. Specifically:

1) pkg_desc_index_line_read has been optimized to skip validation
(biggest performance problem).

2) IndexedPortdb has been optimized to use a single portdbapi.cp_all
call that covers all of the unindexed repositories.

> Also I did not see a way to specify all repos to be index updated.  It is I believe a requirement of this new system.
> Re-running is for each repo installed individually is something to be
reserved for the new postsync() to do when it
> lands in master.

Yeah, I guess we may as well wait for the plugin-sync branch to get
merged first.
-- 
Thanks,
Zac


^ permalink raw reply	[flat|nested] 19+ messages in thread

end of thread, other threads:[~2014-11-04  9:19 UTC | newest]

Thread overview: 19+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-01-01 22:14 [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
2014-01-01 22:14 ` [gentoo-portage-dev] [PATCH 2/2] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
2014-01-01 23:30   ` Brian Dolbec
2014-01-02  8:50   ` [gentoo-portage-dev] " Ryan Hill
2014-01-02  9:24   ` [gentoo-portage-dev] SebastianLuther
2014-01-02  9:24     ` [gentoo-portage-dev] [PATCH] repoman: Add check for missing slot operators (bug 493742) SebastianLuther
2014-01-01 22:46 ` [gentoo-portage-dev] [PATCH 1/2] portdbapi.cp_list(): Don't write into xmatch's "match-all" cache SebastianLuther
2014-01-01 23:29   ` Brian Dolbec
  -- strict thread matches above, loose matches on Subject: below --
2014-10-18  3:28 [gentoo-portage-dev] [PATCH] emerge --search: use description index Zac Medico
2014-11-01 22:46 ` [gentoo-portage-dev] Zac Medico
2014-11-03 21:42   ` [gentoo-portage-dev] Brian Dolbec
2014-11-04  9:19     ` [gentoo-portage-dev] Zac Medico
2014-02-23  8:07 [gentoo-portage-dev] Brian Dolbec
2014-01-28 10:56 [gentoo-portage-dev] Alexander Berntsen
2014-01-28 10:57 ` [gentoo-portage-dev] Alexander Berntsen
2008-02-29  3:50 [gentoo-portage-dev] Tony
2008-02-29 13:27 ` [gentoo-portage-dev] Andrew Gaffney
2007-03-15  6:26 [gentoo-portage-dev] Шурмин Евгений Викторович
2007-02-08  9:41 [gentoo-portage-dev] Шурмин Евгений Викторович
2005-12-11 14:13 [gentoo-portage-dev] Niklas Lindblad

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox