hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1481) Streaming should swallow IOExceptions when closing clientOut
Date Fri, 07 May 2010 23:23:48 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Todd Lipcon updated MAPREDUCE-1481:

    Attachment: TestStreamingDontConsumeInput.java

quickly built a testcase for this, though no patch yet - the code is somewhat spaghetti.

> Streaming should swallow IOExceptions when closing clientOut
> ------------------------------------------------------------
>                 Key: MAPREDUCE-1481
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1481
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.20.1, 0.21.0, 0.22.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: TestStreamingDontConsumeInput.java
> in PipeMapRed.mapRedFinished, streaming flushes and closes clientOut_, the handle to
the subprocess's stdin. If the subprocess has already exited or closed its stdin, this will
generate a Broken Pipe IOException. This causes us to skip waitOutputThreads, which is incorrect,
since the subprocess may have data still written from stdout that needs to be read.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message