From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <gentoo-commits+bounces-618735-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
by finch.gentoo.org (Postfix) with ESMTP id 32FCA1381F3
for <garchives@archives.gentoo.org>; Wed, 14 Aug 2013 13:34:08 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
by pigeon.gentoo.org (Postfix) with SMTP id BF1C8E0BCD;
Wed, 14 Aug 2013 13:34:07 +0000 (UTC)
Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183])
(using TLSv1 with cipher AECDH-AES256-SHA (256/256 bits))
(No client certificate requested)
by pigeon.gentoo.org (Postfix) with ESMTPS id 5E746E0BCD
for <gentoo-commits@lists.gentoo.org>; Wed, 14 Aug 2013 13:34:07 +0000 (UTC)
Received: from hornbill.gentoo.org (hornbill.gentoo.org [94.100.119.163])
(using TLSv1 with cipher AECDH-AES256-SHA (256/256 bits))
(No client certificate requested)
by smtp.gentoo.org (Postfix) with ESMTPS id 522A033EB44
for <gentoo-commits@lists.gentoo.org>; Wed, 14 Aug 2013 13:34:06 +0000 (UTC)
Received: from localhost.localdomain (localhost [127.0.0.1])
by hornbill.gentoo.org (Postfix) with ESMTP id D2B2FE468F
for <gentoo-commits@lists.gentoo.org>; Wed, 14 Aug 2013 13:34:04 +0000 (UTC)
From: "Jauhien Piatlicki" <piatlicki@gmail.com>
To: gentoo-commits@lists.gentoo.org
Content-Transfer-Encoding: 8bit
Content-type: text/plain; charset=UTF-8
Reply-To: gentoo-dev@lists.gentoo.org, "Jauhien Piatlicki" <piatlicki@gmail.com>
Message-ID: <1376487206.0c6eb9864124cee25a5ba407ad01d0bb930b4701.jauhien@gentoo>
Subject: [gentoo-commits] proj/g-sorcery:master commit in: gs_pypi/
X-VCS-Repository: proj/g-sorcery
X-VCS-Files: gs_pypi/pypi_db.py
X-VCS-Directories: gs_pypi/
X-VCS-Committer: jauhien
X-VCS-Committer-Name: Jauhien Piatlicki
X-VCS-Revision: 0c6eb9864124cee25a5ba407ad01d0bb930b4701
X-VCS-Branch: master
Date: Wed, 14 Aug 2013 13:34:04 +0000 (UTC)
Precedence: bulk
List-Post: <mailto:gentoo-commits@lists.gentoo.org>
List-Help: <mailto:gentoo-commits+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-commits+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-commits+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-commits.gentoo.org>
X-BeenThere: gentoo-commits@lists.gentoo.org
X-Archives-Salt: 333454f1-6038-443a-9e0d-212535eeb4ef
X-Archives-Hash: dc376208dcbe9e03927123fd7ad8e1cf
commit: 0c6eb9864124cee25a5ba407ad01d0bb930b4701
Author: Jauhien Piatlicki (jauhien) <piatlicki <AT> gmail <DOT> com>
AuthorDate: Wed Aug 14 13:33:26 2013 +0000
Commit: Jauhien Piatlicki <piatlicki <AT> gmail <DOT> com>
CommitDate: Wed Aug 14 13:33:26 2013 +0000
URL: http://git.overlays.gentoo.org/gitweb/?p=proj/g-sorcery.git;a=commit;h=0c6eb986
gs_pypi/pypi_db: restrict number of attempts to download package page
---
gs_pypi/pypi_db.py | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/gs_pypi/pypi_db.py b/gs_pypi/pypi_db.py
index 69ad476..07fc3bc 100644
--- a/gs_pypi/pypi_db.py
+++ b/gs_pypi/pypi_db.py
@@ -54,13 +54,16 @@ class PypiDBGenerator(DBGenerator):
pkg_uries = self.decode_download_uries(pkg_uries)
for uri in pkg_uries:
+ attempts = 0
while True:
try:
+ attempts += 1
self.process_uri(uri, data)
except DownloadingError as error:
print(str(error))
- time.sleep(2)
- continue
+ time.sleep(5)
+ if attempts < 100:
+ continue
break
return data