hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown
Date Wed, 01 May 2013 03:56:16 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated MAPREDUCE-5194:

    Status: Open  (was: Patch Available)

The approach is incorrect. Interruption of {{InputStream}} requires closing the stream out
of band and relying on the {{SocketException}} to terminate the thread.
> Heed interrupts during Fetcher shutdown
> ---------------------------------------
>                 Key: MAPREDUCE-5194
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5194
>             Project: Hadoop Map/Reduce
>          Issue Type: Task
>          Components: task
>            Reporter: Chris Douglas
>            Priority: Minor
>         Attachments: M5194.patch
> In the current implementation, {{Fetcher}} instances usually exit gracefully when the
shuffle succeeds. When it fails, threads are interrupted, but may continue running harmlessly
until the JVM shuts down.
> However, to generate consistent checkpoints, these threads should exit cleanly to quiesce
the state of the shuffle.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message