reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (REEF-1692) Revert the checking for extra Evaluators requested
Date Thu, 05 Jan 2017 01:40:58 GMT

     [ https://issues.apache.org/jira/browse/REEF-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Julia updated REEF-1692:
------------------------
    Labels: FT  (was: )

> Revert the checking for extra Evaluators requested
> --------------------------------------------------
>
>                 Key: REEF-1692
>                 URL: https://issues.apache.org/jira/browse/REEF-1692
>             Project: REEF
>          Issue Type: Bug
>            Reporter: Julia
>            Priority: Minor
>              Labels: FT
>
> The reason we did REEF-1688 for ignoring extra AllocatedEvaluators was because we thought
Yarn might give us additional Evalautors. In fact, it is a bug in REEF code. REEF-1691 has
been created to fix it. 
> The side effect for ignoring extra IAllocatedEvaluator are:
> * It hides potential bugs
> * Even we choose to ignore the extra IAllocatedEvaluator in EvaluatorManager, this event
can be received in other system state rather than WaitingForEvalautor. This is because as
soon as we get all the needed Evaluators, we change the system state and start to submit tasks,
and the system state can be SubmittingTasks, or ShuttingDown after it. By the time we receive
the extra IAllocatedEvaluator event, it is in                    unexpected state, IMRUDriver
will throw exception in those cases. 
> I would think we should revert the change in REEF-1688 to ensure the integrity of the
system. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message