From: Zac Medico <zmedico@gentoo.org>
To: gentoo-portage-dev@lists.gentoo.org
Cc: Zac Medico <zmedico@gentoo.org>
Subject: [gentoo-portage-dev] [PATCH] AbstractPollTask._read_buf: read regardless of event flags (531724)
Date: Fri, 26 Dec 2014 01:00:41 -0800 [thread overview]
Message-ID: <1419584441-23770-1-git-send-email-zmedico@gentoo.org> (raw)
PipeReaderPtyTestCase shows that data may be lost unless we attempt to
read data for every poll event, regardless of the event flags.
Therefore, always read, regardless of the event flags. This is safe to
do because all consumers of this API use non-blocking mode and properly
handle EAGAIN (signaled when this method returns None).
X-Gentoo-Bug: 531724
X-Gentoo-Bug-URL: https://bugs.gentoo.org/show_bug.cgi?id=531724
---
pym/_emerge/AbstractPollTask.py | 50 +++++++++++++++++++++++------------------
1 file changed, 28 insertions(+), 22 deletions(-)
diff --git a/pym/_emerge/AbstractPollTask.py b/pym/_emerge/AbstractPollTask.py
index 3f6dd6c..48e7590 100644
--- a/pym/_emerge/AbstractPollTask.py
+++ b/pym/_emerge/AbstractPollTask.py
@@ -78,33 +78,39 @@ class AbstractPollTask(AsynchronousTask):
def _read_buf(self, fd, event):
"""
- | POLLIN | RETURN
- | BIT | VALUE
- | ---------------------------------------------------
- | 1 | Read self._bufsize into a string of bytes,
- | | handling EAGAIN and EIO. An empty string
- | | of bytes indicates EOF.
- | ---------------------------------------------------
- | 0 | None
+ Read self._bufsize into a string of bytes, handling EAGAIN and
+ EIO. This will only call os.read() once, so the caller should
+ call this method in a loop until either None or an empty string
+ of bytes is returned. An empty string of bytes indicates EOF.
+ None indicates EAGAIN.
+
+ NOTE: os.read() will be called regardless of the event flags,
+ since otherwise data may be lost (see bug #531724).
+
+ @param fd: file descriptor (non-blocking mode required)
+ @type fd: int
+ @param event: poll event flags
+ @type event: int
+ @rtype: bytes or None
+ @return: A string of bytes, or None
"""
# NOTE: array.fromfile() is no longer used here because it has
# bugs in all known versions of Python (including Python 2.7
# and Python 3.2).
buf = None
- if event & self.scheduler.IO_IN:
- try:
- buf = os.read(fd, self._bufsize)
- except OSError as e:
- # EIO happens with pty on Linux after the
- # slave end of the pty has been closed.
- if e.errno == errno.EIO:
- # EOF: return empty string of bytes
- buf = b''
- elif e.errno == errno.EAGAIN:
- # EAGAIN: return None
- buf = None
- else:
- raise
+ try:
+ buf = os.read(fd, self._bufsize)
+ except OSError as e:
+ # EIO happens with pty on Linux after the
+ # slave end of the pty has been closed.
+ if e.errno == errno.EIO:
+ # EOF: return empty string of bytes
+ buf = b''
+ elif e.errno == errno.EAGAIN:
+ # EAGAIN: return None
+ buf = None
+ else:
+ raise
return buf
--
2.0.5
next reply other threads:[~2014-12-26 9:01 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-12-26 9:00 Zac Medico [this message]
2015-01-05 12:52 ` [gentoo-portage-dev] [PATCH] AbstractPollTask._read_buf: read regardless of event flags (531724) Alexander Berntsen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1419584441-23770-1-git-send-email-zmedico@gentoo.org \
--to=zmedico@gentoo.org \
--cc=gentoo-portage-dev@lists.gentoo.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox