Mailing-List: contact dev-help@reef.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@reef.apache.org
Date: Wed, 19 Oct 2016 00:16:58 +0000 (UTC)
From: "Sergiy Matusevych (JIRA)" <jira@apache.org>
To: dev@reef.apache.org
Message-ID: <JIRA.12986901.1467742371000.23286.1476836218465@Atlassian.JIRA>
In-Reply-To: <JIRA.12986901.1467742371000@Atlassian.JIRA>
References: <JIRA.12986901.1467742371000@Atlassian.JIRA> <JIRA.12986901.1467742371213@arcas>
Subject: [jira] [Comment Edited] (REEF-1482) IMRU driver does not exit even
 if all the task exit normally
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 19 Oct 2016 00:17:00 -0000


    [ https://issues.apache.org/jira/browse/REEF-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586869#comment-15586869 ] 

Sergiy Matusevych edited comment on REEF-1482 at 10/19/16 12:16 AM:
--------------------------------------------------------------------

I think we have to build the simplest reproducible test for this issue. One thing that I would suggest is to try Java-only application with minimal functionality, e.g. {{org.apache.reef.examples.pool.Launch}} application from {{reef-examples}}. All that application does is launching the specified number of tasks that just sleep for a given number of seconds and then quit. e.g. the following command

{code}
.\bin\runreef.ps1 -Jars C:\Users\sergiym.REDMOND\devel\reef\lang\java\reef-tests\target\reef-tests-0.16.0-SNAPSHOT-test-jar-with-dependencies.jar -Class org.apache.reef.examples.pool.Launch -VerboseLog -evaluators 4 -tasks 16 -delay 5 -id 100 -local true
{code}

will request 4 evaluators, and submit 16 tasks to them (the driver will submit a task to the evaluator as soon as it is done with the previous one). Each task here simply sleeps for 5 seconds and quits. {{-local true}} runs the job locally; use {{-local false}} to submit it to YARN. {{-id 100}} is simply a numeric ID that helps to distinguish between different experiments.


was (Author: motus):
I think we have to build the simplest reproducible test for this issue. One thing that I would suggest is to try Java-only application with minimal functionality, e.g. {{org.apache.reef.examples.pool.Launch}} application from {{reef-examples}}. All that application does is launching the specified number of tasks that just sleep for a given number of seconds and then quit. e.g. the following command

{code}
.\bin\runreef.ps1 -Jars C:\Users\sergiym.REDMOND\devel\reef\lang\java\reef-tests\target\reef-tests-0.16.0-SNAPSHOT-test-jar-with-dependencies.jar -Class org.apache.reef.examples.pool.Launch -evaluators 4 -tasks 16 -delay 5 -id 100 -local true
{code}

will request 4 evaluators, and submit 16 tasks to them (the driver will submit a task to the evaluator as soon as it is done with the previous one). Each task here simply sleeps for 5 seconds and quits. {{-local true}} runs the job locally; use {{-local false}} to submit it to YARN. {{-id 100}} is simply a numeric ID that helps to distinguish between different experiments.

> IMRU driver does not exit even if all the task exit normally
> ------------------------------------------------------------
>
>                 Key: REEF-1482
>                 URL: https://issues.apache.org/jira/browse/REEF-1482
>             Project: REEF
>          Issue Type: Bug
>          Components: REEF.NET
>         Environment: C#
>            Reporter: Dhruv Mahajan
>
> Recently, upon running IMRU with large number of mappers, it is observed intermittently that IMRU driver does exit while all other tasks (map and update) exit normally without any issues. 
> The aim of this JIRA is to fix it.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)