Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B83D1876E for ; Tue, 24 Nov 2015 13:09:16 +0000 (UTC) Received: (qmail 88963 invoked by uid 500); 24 Nov 2015 13:09:11 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 88857 invoked by uid 500); 24 Nov 2015 13:09:11 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 88809 invoked by uid 99); 24 Nov 2015 13:09:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Nov 2015 13:09:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 049B32C1F57 for ; Tue, 24 Nov 2015 13:09:11 +0000 (UTC) Date: Tue, 24 Nov 2015 13:09:11 +0000 (UTC) From: "Junping Du (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Assigned] (MAPREDUCE-6545) Test committer.commitJob() behavior during committing when MR AM get failed. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-6545: ------------------------------------- Assignee: Junping Du > Test committer.commitJob() behavior during committing when MR AM get failed. > ---------------------------------------------------------------------------- > > Key: MAPREDUCE-6545 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6545 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Reporter: Junping Du > Assignee: Junping Du > > In MAPREDUCE-5485, we are adding additional API (isCommitJobRepeatable) to allow job commit can tolerate AM failure in some cases (like FileOutputCommitter in v2 algorithm). Although we have unit test to cover most of flows, we may want a completed end to end test to verify the whole work flow. > The scenario include: > 1. For FileOutputCommitter (or some sub class), emulate a MR AM failure or restart during commitJob() in progress > 2. Check different behavior for v1 and v2 (support isCommitJobRepeatable() or not) -- This message was sent by Atlassian JIRA (v6.3.4#6332)