Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D18471742B for ; Mon, 11 May 2015 23:28:00 +0000 (UTC) Received: (qmail 3389 invoked by uid 500); 11 May 2015 23:28:00 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 3331 invoked by uid 500); 11 May 2015 23:28:00 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 3319 invoked by uid 99); 11 May 2015 23:28:00 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 May 2015 23:28:00 +0000 Date: Mon, 11 May 2015 23:28:00 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-13585) HRegionFileSystem#splitStoreFile() finishes without closing the file handle in some situation MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-13585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538870#comment-14538870 ] Hudson commented on HBASE-13585: -------------------------------- FAILURE: Integrated in HBase-0.98 #983 (See [https://builds.apache.org/job/HBase-0.98/983/]) HBASE-13585 HRegionFileSystem#splitStoreFile() finishes without closing the file handle in some situation (Stephen Yuan Jiang) (apurtell: rev 368329dec9d0c2fbed9ddd53ccf503ff892e62bc) * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java > HRegionFileSystem#splitStoreFile() finishes without closing the file handle in some situation > --------------------------------------------------------------------------------------------- > > Key: HBASE-13585 > URL: https://issues.apache.org/jira/browse/HBASE-13585 > Project: HBase > Issue Type: Bug > Components: regionserver > Affects Versions: 2.0.0, 1.1.0, 1.2.0 > Environment: Windows > Reporter: Stephen Yuan Jiang > Assignee: Stephen Yuan Jiang > Fix For: 2.0.0, 1.1.0, 0.98.13, 1.0.2, 1.2.0 > > Attachments: HBASE-13585-0.98.patch, HBASE-13585.v1-mater.patch > > > HRegionFileSystem#splitStoreFile() opens a reader and does not close it in some situation. > In Windows, TestSplitTransaction#testWholesomeSplit() consistently failed due to open file handle left at the end of test > {noformat} > Failed delete of C:/hbase/hbase-server/target/test-data/b470118c-978a-4915-8a12-b29b2c966beb/org.apache.hadoop.hbase.regionserver.TestSplitTransaction/data/default/table/a578b53b3c3a947c5f617c51ccb982cf > Stacktrace > java.io.IOException: Failed delete of C:/hbase/hbase-server/target/test-data/b470118c-978a-4915-8a12-b29b2c966beb/org.apache.hadoop.hbase.regionserver.TestSplitTransaction/data/default/table/a578b53b3c3a947c5f617c51ccb982cf > at org.apache.hadoop.hbase.regionserver.TestSplitTransaction.teardown(TestSplitTransaction.java:106) > Standard Error > 2015-04-26 12:57:43,863 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\.0519debf2b934245a9a8c3d7cfc0f51d.crc]: it still exists. > 2015-04-26 12:57:43,864 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\.45fd4e817ce64759abc6e982a5c0b830.crc]: it still exists. > 2015-04-26 12:57:43,865 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\.8e6bc752c9fc414abfe085f8959dce94.crc]: it still exists. > 2015-04-26 12:57:43,870 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\0519debf2b934245a9a8c3d7cfc0f51d]: it still exists. > 2015-04-26 12:57:43,870 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\45fd4e817ce64759abc6e982a5c0b830]: it still exists. > 2015-04-26 12:57:43,871 WARN [main] fs.FileUtil(187): Failed to delete file or dir [C:\hbase\hbase-server\target\test-data\b470118c-978a-4915-8a12-b29b2c966beb\org.apache.hadoop.hbase.regionserver.TestSplitTransaction\data\default\table\a578b53b3c3a947c5f617c51ccb982cf\info\8e6bc752c9fc414abfe085f8959dce94]: it still exists. > {noformat} > HBASE-8300 tried to fix this issue by adding 'StoreFile#closeReader()' call. However, after the open reader calls, there are 4 'return null' calls before the close call. When I run TestSplitTransaction#testWholesomeSplit(), 2 of the 'return null' calls were hit multiple times (which means the opened file is not closed). > The fix needs to make sure that StoreFile#closeReader() is called in all situation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)