tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3833) Tasks should report codec errors during shuffle as fetch failures
Date Fri, 22 Sep 2017 15:25:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16176580#comment-16176580
] 

Kuhu Shukla commented on TEZ-3833:
----------------------------------

bq. I'm not sure it makes sense to wrap the InternalError in a timeout exception since it
really isn't a timeout exception.
I agree. I am thinking of throwing the exception as FetcherReadTimeoutException if it is an
IOE (as in the existing code) and as it is if it is InternalError. {{copyFromHost}} can then
catch both and do the same cleanupConnection and connect with retry. Does that make sense?
 

> Tasks should report codec errors during shuffle as fetch failures
> -----------------------------------------------------------------
>
>                 Key: TEZ-3833
>                 URL: https://issues.apache.org/jira/browse/TEZ-3833
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>         Attachments: TEZ-3833.001.patch, TEZ-3833.002.patch
>
>
> Do the equivalent of https://issues.apache.org/jira/browse/MAPREDUCE-6633 so that compression
errors do not prove fatal for the DAG/tasks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message