reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dhruv Mahajan (JIRA)" <>
Subject [jira] [Commented] (REEF-1224) IMRU Fault Tolerance - Separate Data downloading from Task injection
Date Mon, 28 Mar 2016 18:31:25 GMT


Dhruv Mahajan commented on REEF-1224:

One more question: Suppose I instantiate {{NetworkService}} as part of {{Task}}. Let's assume
that task gets completed and exits. Now there would be a lag between when network service
is disposed by GC and Evaluator sends message that task is done, right? So even if while disposing
we get all these stream closing and read failures message, the task would be deemed as success
right? But then when Garbage Collector runs and then these stream errors get thrown, will
it throw failed evaluator message? I am little unclear about this. This whole asynchronous
Read business is tricky since read are asynchronous. 

> IMRU Fault Tolerance - Separate Data downloading from Task injection
> --------------------------------------------------------------------
>                 Key: REEF-1224
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: IMRU, REEF.NET
>            Reporter: Julia
>            Assignee: Dhruv Mahajan
> Currently in IMRU, data downloading happens during the Task injection. It couples the
data and Task object. In Fault tolerant case, we would like to only resubmit a task but use
the data that have been downloaded, That requires us to decouple those two portions. For example,
data downloading portion can be attached to Context, and we can then resubmit a task on the
same context. 

This message was sent by Atlassian JIRA

View raw message