Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8584910BD4 for ; Tue, 10 Sep 2013 02:35:54 +0000 (UTC) Received: (qmail 55853 invoked by uid 500); 10 Sep 2013 02:35:53 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 55778 invoked by uid 500); 10 Sep 2013 02:35:52 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 55762 invoked by uid 99); 10 Sep 2013 02:35:51 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 02:35:51 +0000 Date: Tue, 10 Sep 2013 02:35:51 +0000 (UTC) From: "Ted Yu (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-9485) TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-9485: -------------------------- Attachment: 9485-v1.txt Patch v1 makes TableOutputCommitter extend FileOutputCommitter > TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart > -------------------------------------------------------------------------------------------------- > > Key: HBASE-9485 > URL: https://issues.apache.org/jira/browse/HBASE-9485 > Project: HBase > Issue Type: Bug > Reporter: Ted Yu > Assignee: Ted Yu > Attachments: 9485-v1.txt > > > HBase extends OutputCommitter which turns recovery off. Meaning all completed maps are lost on RM restart and job starts from scratch. FileOutputCommitter implements recovery so we should look at that to see what is potentially needed for recovery. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira