Return-Path: X-Original-To: apmail-reef-dev-archive@minotaur.apache.org Delivered-To: apmail-reef-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A7B8819FAB for ; Tue, 22 Mar 2016 20:46:26 +0000 (UTC) Received: (qmail 28028 invoked by uid 500); 22 Mar 2016 20:46:25 -0000 Delivered-To: apmail-reef-dev-archive@reef.apache.org Received: (qmail 27873 invoked by uid 500); 22 Mar 2016 20:46:25 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 27580 invoked by uid 99); 22 Mar 2016 20:46:25 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2016 20:46:25 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A749D2C1F69 for ; Tue, 22 Mar 2016 20:46:25 +0000 (UTC) Date: Tue, 22 Mar 2016 20:46:25 +0000 (UTC) From: "Markus Weimer (JIRA)" To: dev@reef.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (REEF-1224) IMRU Fault Tolerance - Separate Data downloading from Task injection MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/REEF-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207260#comment-15207260 ] Markus Weimer commented on REEF-1224: ------------------------------------- The code you have should work, and the constructor of {{DataLoadingContext}} should only be invoked once. Hence, this looks like a bug to me. Can you simplify your case into a test? We can then work on a fix. > IMRU Fault Tolerance - Separate Data downloading from Task injection > -------------------------------------------------------------------- > > Key: REEF-1224 > URL: https://issues.apache.org/jira/browse/REEF-1224 > Project: REEF > Issue Type: Improvement > Components: IMRU, REEF.NET > Reporter: Julia > Assignee: Dhruv Mahajan > > Currently in IMRU, data downloading happens during the Task injection. It couples the data and Task object. In Fault tolerant case, we would like to only resubmit a task but use the data that have been downloaded, That requires us to decouple those two portions. For example, data downloading portion can be attached to Context, and we can then resubmit a task on the same context. -- This message was sent by Atlassian JIRA (v6.3.4#6332)