Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 914A21037B for ; Tue, 18 Feb 2014 19:36:28 +0000 (UTC) Received: (qmail 20902 invoked by uid 500); 18 Feb 2014 19:36:20 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 20833 invoked by uid 500); 18 Feb 2014 19:36:20 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 20822 invoked by uid 99); 18 Feb 2014 19:36:19 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Feb 2014 19:36:19 +0000 Date: Tue, 18 Feb 2014 19:36:19 +0000 (UTC) From: "Lars Hofhansl (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HBASE-10546) Two scanner objects are open for each hbase map task but only one scanner object is closed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-10546. ----------------------------------- Resolution: Fixed Hadoop Flags: Reviewed Committed trunk version to all branches. Thanks [~vasu.mariyala@gmail.com]. > Two scanner objects are open for each hbase map task but only one scanner object is closed > ------------------------------------------------------------------------------------------ > > Key: HBASE-10546 > URL: https://issues.apache.org/jira/browse/HBASE-10546 > Project: HBase > Issue Type: Bug > Reporter: Vasu Mariyala > Assignee: Vasu Mariyala > Fix For: 0.96.2, 0.98.1, 0.99.0, 0.94.17 > > Attachments: 0.94-HBASE-10546.patch, trunk-HBASE-10546.patch > > > Map reduce framework calls createRecordReader of the TableInputFormat/MultiTableInputFormat to get the record reader instance. In this method, we are initializing the TableRecordReaderImpl (restart method). This initializes the scanner object. After this, map reduce framework calls initialize on the RecordReader. In our case, this calls restart of the TableRecordReaderImpl again. Here, it doesn't close the first scanner. At the end of the task, only the second scanner object is closed. Because of this, the smallest read point of HRegion is affected. > We don't need to initialize the RecordReader in the createRecordReader method and we need to close the scanner object in the restart method. (incase if the restart method is called because of exceptions in the nextKeyValue method) -- This message was sent by Atlassian JIRA (v6.1.5#6160)