tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From László Bodor (Jira) <j...@apache.org>
Subject [jira] [Updated] (TEZ-4061) InputAttemptIdentifier and CompositeInputAttemptIdentifier cannot be compared for equality
Date Fri, 25 Jun 2021 10:02:00 GMT

     [ https://issues.apache.org/jira/browse/TEZ-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

László Bodor updated TEZ-4061:
------------------------------
    Fix Version/s:     (was: 0.10.1)
                   0.10.2

> InputAttemptIdentifier and CompositeInputAttemptIdentifier cannot be compared for equality
> ------------------------------------------------------------------------------------------
>
>                 Key: TEZ-4061
>                 URL: https://issues.apache.org/jira/browse/TEZ-4061
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.9.1
>            Reporter: Sungwoo
>            Priority: Major
>             Fix For: 0.10.2
>
>         Attachments: diff.diff
>
>
> InputFailedEvent creates InputAttemtpIdentifier. Since InputAttemptIdentifier.equals()
tests getClass(), comparing InputAttemptIdentifier and CompositeAttemptIdentifier always returns
false. As a result, the obsolete event reported in InputFailedEvent never matches CompositeAttemptIdentifier
contained in ShuffleManager.obsoletedInputs and ShuffleScheduler.obsoleteInputs.
> When the input of a Task becomes lost, this leads to many redundant reports of fetch
failures.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message