From: "Zac Medico" <zmedico@gentoo.org>
To: gentoo-commits@lists.gentoo.org
Subject: [gentoo-commits] proj/portage:master commit in: pym/portage/cache/
Date: Sun, 24 Jul 2016 23:22:06 +0000 (UTC) [thread overview]
Message-ID: <1469401801.5652bc88514bdb36b36b544f7fc7e623cf25caae.zmedico@gentoo> (raw)
commit: 5652bc88514bdb36b36b544f7fc7e623cf25caae
Author: Zac Medico <zmedico <AT> gentoo <DOT> org>
AuthorDate: Sun Jul 24 22:44:31 2016 +0000
Commit: Zac Medico <zmedico <AT> gentoo <DOT> org>
CommitDate: Sun Jul 24 23:10:01 2016 +0000
URL: https://gitweb.gentoo.org/proj/portage.git/commit/?id=5652bc88
flat_hash: use mkstemp in _setitem
Fix the _setitem method to use mkstemp in order to avoid a
race condition when multiple pid namespaces share the same
cache directory.
Reported-by: Mike Frysinger <vapier <AT> chromium.org>
X-Chromium-Bug: 477727
X-Chromium-Bug-url: https://bugs.chromium.org/p/chromium/issues/detail?id=477727
pym/portage/cache/flat_hash.py | 49 +++++++++++++++++++++---------------------
1 file changed, 24 insertions(+), 25 deletions(-)
diff --git a/pym/portage/cache/flat_hash.py b/pym/portage/cache/flat_hash.py
index 3a899c0..7978324 100644
--- a/pym/portage/cache/flat_hash.py
+++ b/pym/portage/cache/flat_hash.py
@@ -1,4 +1,4 @@
-# Copyright 2005-2014 Gentoo Foundation
+# Copyright 2005-2016 Gentoo Foundation
# Distributed under the terms of the GNU General Public License v2
# Author(s): Brian Harring (ferringb@gentoo.org)
@@ -10,6 +10,7 @@ import errno
import io
import stat
import sys
+import tempfile
import os as _os
from portage import os
from portage import _encodings
@@ -66,27 +67,14 @@ class database(fs_template.FsBased):
raise cache_errors.CacheCorruption(cpv, e)
def _setitem(self, cpv, values):
- s = cpv.rfind("/")
- fp = os.path.join(self.location,cpv[:s],".update.%i.%s" % (os.getpid(), cpv[s+1:]))
try:
- myf = io.open(_unicode_encode(fp,
- encoding=_encodings['fs'], errors='strict'),
- mode='w', encoding=_encodings['repo.content'],
- errors='backslashreplace')
- except (IOError, OSError) as e:
- if errno.ENOENT == e.errno:
- try:
- self._ensure_dirs(cpv)
- myf = io.open(_unicode_encode(fp,
- encoding=_encodings['fs'], errors='strict'),
- mode='w', encoding=_encodings['repo.content'],
- errors='backslashreplace')
- except (OSError, IOError) as e:
- raise cache_errors.CacheCorruption(cpv, e)
- else:
- raise cache_errors.CacheCorruption(cpv, e)
+ fd, fp = tempfile.mkstemp(dir=self.location)
+ except EnvironmentError as e:
+ raise cache_errors.CacheCorruption(cpv, e)
- try:
+ with io.open(fd, mode='w',
+ encoding=_encodings['repo.content'],
+ errors='backslashreplace') as myf:
for k in self._write_keys:
v = values.get(k)
if not v:
@@ -95,8 +83,7 @@ class database(fs_template.FsBased):
# k and v are coerced to unicode, in order to prevent TypeError
# when writing raw bytes to TextIOWrapper with Python 2.
myf.write("%s=%s\n" % (k, v))
- finally:
- myf.close()
+
self._ensure_access(fp)
#update written. now we move it.
@@ -104,9 +91,21 @@ class database(fs_template.FsBased):
new_fp = os.path.join(self.location,cpv)
try:
os.rename(fp, new_fp)
- except (OSError, IOError) as e:
- os.remove(fp)
- raise cache_errors.CacheCorruption(cpv, e)
+ except EnvironmentError as e:
+ success = False
+ try:
+ if errno.ENOENT == e.errno:
+ try:
+ self._ensure_dirs(cpv)
+ os.rename(fp, new_fp)
+ success = True
+ except EnvironmentError as e:
+ raise cache_errors.CacheCorruption(cpv, e)
+ else:
+ raise cache_errors.CacheCorruption(cpv, e)
+ finally:
+ if not success:
+ os.remove(fp)
def _delitem(self, cpv):
# import pdb;pdb.set_trace()
next reply other threads:[~2016-07-24 23:22 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-07-24 23:22 Zac Medico [this message]
-- strict thread matches above, loose matches on Subject: below --
2016-09-19 16:57 [gentoo-commits] proj/portage:master commit in: pym/portage/cache/ Zac Medico
2016-07-13 11:32 Zac Medico
2015-12-29 16:42 Zac Medico
2015-12-29 16:42 Zac Medico
2015-12-29 16:42 Zac Medico
2014-11-14 17:33 Zac Medico
2013-07-26 8:23 Arfrever Frehtes Taifersar Arahesis
2013-07-26 7:57 Zac Medico
2013-01-18 17:12 Zac Medico
2013-01-18 16:37 Zac Medico
2013-01-18 15:32 Zac Medico
2012-11-21 4:38 Zac Medico
2012-10-02 20:30 Zac Medico
2012-09-25 3:44 Zac Medico
2012-09-25 1:54 Zac Medico
2012-09-25 1:42 Zac Medico
2012-09-18 19:02 Zac Medico
2012-06-10 8:35 Zac Medico
2012-06-10 8:28 Zac Medico
2012-06-10 8:25 Zac Medico
2012-05-24 19:06 Zac Medico
2012-05-23 19:00 Zac Medico
2011-10-29 23:10 Zac Medico
2011-10-18 5:26 Zac Medico
2011-10-14 15:30 Zac Medico
2011-09-07 15:56 Zac Medico
2011-05-12 19:05 Zac Medico
2011-05-12 19:02 Zac Medico
2011-05-12 19:02 Zac Medico
2011-02-08 6:37 Zac Medico
2011-02-07 0:14 Zac Medico
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1469401801.5652bc88514bdb36b36b544f7fc7e623cf25caae.zmedico@gentoo \
--to=zmedico@gentoo.org \
--cc=gentoo-commits@lists.gentoo.org \
--cc=gentoo-dev@lists.gentoo.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox