Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E896F10BFF for ; Wed, 4 Dec 2013 01:12:35 +0000 (UTC) Received: (qmail 94601 invoked by uid 500); 4 Dec 2013 01:12:35 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 94570 invoked by uid 500); 4 Dec 2013 01:12:35 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 94561 invoked by uid 99); 4 Dec 2013 01:12:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Dec 2013 01:12:35 +0000 Date: Wed, 4 Dec 2013 01:12:35 +0000 (UTC) From: "Devaraj Das (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-9485) TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838439#comment-13838439 ] Devaraj Das commented on HBASE-9485: ------------------------------------ +1 from me as well. Thanks [~vinodkv] for the explanation. > TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart > -------------------------------------------------------------------------------------------------- > > Key: HBASE-9485 > URL: https://issues.apache.org/jira/browse/HBASE-9485 > Project: HBase > Issue Type: Bug > Components: mapreduce > Reporter: Ted Yu > Assignee: Ted Yu > Attachments: 9485-v2.txt > > > HBase extends OutputCommitter which turns recovery off. Meaning all completed maps are lost on RM restart and job starts from scratch. FileOutputCommitter implements recovery so we should look at that to see what is potentially needed for recovery. -- This message was sent by Atlassian JIRA (v6.1#6144)