reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <>
Subject [jira] [Created] (REEF-1692) Revert the checking for extra Evaluators requested
Date Thu, 05 Jan 2017 01:39:58 GMT
Julia created REEF-1692:

             Summary: Revert the checking for extra Evaluators requested
                 Key: REEF-1692
             Project: REEF
          Issue Type: Bug
            Reporter: Julia
            Priority: Minor

The reason we did REEF-1688 for ignoring extra AllocatedEvaluators was because we thought
Yarn might give us additional Evalautors. In fact, it is a bug in REEF code. REEF-1691 has
been created to fix it. 

The side effect for ignoring extra IAllocatedEvaluator are:
* It hides potential bugs
* Even we choose to ignore the extra IAllocatedEvaluator in EvaluatorManager, this event can
be received in other system state rather than WaitingForEvalautor. This is because as soon
as we get all the needed Evaluators, we change the system state and start to submit tasks,
and the system state can be SubmittingTasks, or ShuttingDown after it. By the time we receive
the extra IAllocatedEvaluator event, it is in                    unexpected state, IMRUDriver
will throw exception in those cases. 

I would think we should revert the change in REEF-1688 to ensure the integrity of the system.

This message was sent by Atlassian JIRA

View raw message