tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3833) Tasks should report codec errors during shuffle as fetch failures
Date Mon, 18 Sep 2017 20:31:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16170632#comment-16170632
] 

Jason Lowe commented on TEZ-3833:
---------------------------------

Thanks for updating the patch!

Rather than replicate the code for a separate InternalError catch clause, it would be simpler
to change the shouldRetry signature to take an Exception rather than an IOException so we
can reuse the error handling logic.  Despite the incorrect Javadocs for it, it does not throw
IOException or really require the exception to be an instance of IOException to do what it
does.

I'm not sure it makes sense to wrap the InternalError in a timeout exception since it really
isn't a timeout exception.


> Tasks should report codec errors during shuffle as fetch failures
> -----------------------------------------------------------------
>
>                 Key: TEZ-3833
>                 URL: https://issues.apache.org/jira/browse/TEZ-3833
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>         Attachments: TEZ-3833.001.patch, TEZ-3833.002.patch
>
>
> Do the equivalent of https://issues.apache.org/jira/browse/MAPREDUCE-6633 so that compression
errors do not prove fatal for the DAG/tasks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message