[ https://issues.apache.org/jira/browse/TEZ-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179129#comment-14179129
]
Siddharth Seth commented on TEZ-1567:
-------------------------------------
bq. Yes. The bottomline is to not send out unnecessary events because a blacklisted node will
be immediately unblacklisted on hitting the threshold.
That's not being done. Events going out and then immediately being told to unblacklist is
the behviour before the patch.
- node.registerAsBlacklisted(); triggers computeIgnoreThreshold.
- The subsequent check isBlacklistingActive - verifies whether the node should move into blacklisted
state (i.e. the state of the ignoreBlacklisting flag)
- Only if that is hit, does it blacklist itself and send out events.
> Avoid blacklisting nodes when the disable blacklisting threshold is about to be hit
> -----------------------------------------------------------------------------------
>
> Key: TEZ-1567
> URL: https://issues.apache.org/jira/browse/TEZ-1567
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-1567.1.txt
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
|