Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9770B200AED for ; Tue, 3 May 2016 21:45:14 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 95E711609F4; Tue, 3 May 2016 21:45:14 +0200 (CEST) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DCB671609A9 for ; Tue, 3 May 2016 21:45:13 +0200 (CEST) Received: (qmail 36597 invoked by uid 500); 3 May 2016 19:45:13 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 36584 invoked by uid 99); 3 May 2016 19:45:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 May 2016 19:45:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id E2EB02C14F9 for ; Tue, 3 May 2016 19:45:12 +0000 (UTC) Date: Tue, 3 May 2016 19:45:12 +0000 (UTC) From: "Markus Weimer (JIRA)" To: dev@reef.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (REEF-1304) Create tests which use .NET Poison to validate evaluator failure scenarios MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 03 May 2016 19:45:14 -0000 [ https://issues.apache.org/jira/browse/REEF-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15269442#comment-15269442 ] Markus Weimer commented on REEF-1304: ------------------------------------- We don't have a public API that triggers before the first {{OnContextStart}}. Maybe we need to add a specific API in the Evaluator purely for this failure testing? > Create tests which use .NET Poison to validate evaluator failure scenarios > -------------------------------------------------------------------------- > > Key: REEF-1304 > URL: https://issues.apache.org/jira/browse/REEF-1304 > Project: REEF > Issue Type: Test > Components: REEF.NET > Reporter: Mariia Mykhailova > Assignee: Mariia Mykhailova > Labels: FT > Original Estimate: 168h > Remaining Estimate: 168h > > There are multiple scenarios of failures in our system. We should use REEF.NET Poison (delayed fault injection mechanism) to simulate these scenarios in test and to validate the response of our system to them. > Here is initial list of tests we need to have. > *Evaluator Failure* > We expect to receive only {{FailedEvaluator}} event, no {{FailedContext}} and no {{FailedTask}} > || N || Failure injected at || Additional verification || > | 1 | ON_EVALUATOR_ALLOCATED | | > | 2 | between ON_EVALUATOR_ALLOCATED and ON_CONTEXT_ACTIVE | | > | 3 | ON_CONTEXT_ACTIVE | FailedEvaluator should have FailedContexts filled | > | 4 | between ON_CONTEXT_ACTIVE and ON_TASK_RUNNING | FailedEvaluator should have FailedContexts filled | > | 5 | ON_TASK_RUNNING | FailedEvaluator should have FailedContexts and FailedTask filled | > | 6 | between ON_TASK_RUNNING and ON_TASK_COMPLETED | FailedEvaluator should have FailedContexts and FailedTask filled | > | 7 | ON_TASK_COMPLETED | FailedEvaluator should have FailedContexts filled | > | 8 | after ON_TASK_COMPLETED | race against evaluator completion | -- This message was sent by Atlassian JIRA (v6.3.4#6332)