tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3985) Correctness: Throw a clear exception for DMEs sent during cleanup
Date Tue, 28 Aug 2018 16:40:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595259#comment-16595259

Gopal V commented on TEZ-3985:

Interestingly, this does not get logged at all - because the cleanup ignores all exceptions
(however, the correctness issue is resolved).

This needs to instead log something explicitly like "Cowardly not sending events during cleanup",
new Throwable() or something like that.

> Correctness: Throw a clear exception for DMEs sent during cleanup
> -----------------------------------------------------------------
>                 Key: TEZ-3985
>                 URL: https://issues.apache.org/jira/browse/TEZ-3985
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Jaume M
>            Priority: Major
>         Attachments: TEZ-3985.1.patch
> If a DME is sent during cleanup, that implies that the .close() of the LogicalIOProcessorRuntimeTask
did not succeed and therefore these events are an error condition.
> These events should not be sent and more importantly should be received by the AM.
> Throw a clear exception, in case of this & allow the developers to locate the extraneous
event from the backtrace.

This message was sent by Atlassian JIRA

View raw message