Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Date: Sat, 15 Feb 2014 01:01:26 +0000 (UTC)
From: "Vasu Mariyala (JIRA)" <jira@apache.org>
To: dev@hbase.apache.org
Message-ID: <JIRA.12695329.1392426043650.47592.1392426086905@arcas>
In-Reply-To: <JIRA.12695329.1392426043650@arcas>
References: <JIRA.12695329.1392426043650@arcas>
Subject: [jira] [Created] (HBASE-10546) Two scanner objects are open for
 each hbase map task but only one scanner object is closed
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Vasu Mariyala created HBASE-10546:
-------------------------------------

             Summary: Two scanner objects are open for each hbase map task but only one scanner object is closed
                 Key: HBASE-10546
                 URL: https://issues.apache.org/jira/browse/HBASE-10546
             Project: HBase
          Issue Type: Bug
            Reporter: Vasu Mariyala


Map reduce framework calls createRecordReader of the TableInputFormat/MultiTableInputFormat to get the record reader instance. In this method, we are initializing the TableRecordReaderImpl (restart method). This initializes the scanner object. After this, map reduce framework calls initialize on the RecordReader. In our case, this calls restart of the TableRecordReaderImpl again. Here, it doesn't close the first scanner. At the end of the task, only the second scanner object is closed. Because of this, the smallest read point of HRegion is affected.

We don't need to initialize the RecordReader in the createRecordReader method and we need to close the scanner object in the restart method. (incase if the restart method is called because of exceptions in the nextKeyValue method)


--
This message was sent by Atlassian JIRA
(v6.1.5#6160)