Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 21343 invoked from network); 30 Jan 2008 06:52:57 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 30 Jan 2008 06:52:57 -0000 Received: (qmail 70614 invoked by uid 500); 30 Jan 2008 06:52:46 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 70578 invoked by uid 500); 30 Jan 2008 06:52:46 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 70569 invoked by uid 99); 30 Jan 2008 06:52:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Jan 2008 22:52:46 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Jan 2008 06:52:27 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 8C72F71423E for ; Tue, 29 Jan 2008 22:52:34 -0800 (PST) Message-ID: <32111807.1201675954573.JavaMail.jira@brutus> Date: Tue, 29 Jan 2008 22:52:34 -0800 (PST) From: "Billy Pearson (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-2741) [hbase] Split failed due to spliting of a split before compaction could complete after first split. In-Reply-To: <10469735.1201674034084.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12563860#action_12563860 ] Billy Pearson commented on HADOOP-2741: --------------------------------------- I thought this was from a call to a file split but looking now and see what failed somehow the file just is not there. I was testing the splits to see if the split would fail if all family columns where not compacted before the next split so we would have to reference source file 2 split levels but not sure if this is the bug that did the above error or not. > [hbase] Split failed due to spliting of a split before compaction could complete after first split. > --------------------------------------------------------------------------------------------------- > > Key: HADOOP-2741 > URL: https://issues.apache.org/jira/browse/HADOOP-2741 > Project: Hadoop Core > Issue Type: Bug > Components: contrib/hbase > Environment: svc hadoop 616618 > Reporter: Billy Pearson > Fix For: 0.16.0 > > > This error happened after a region tried to split before a complete compaction could be done on the region from the first split > I thank we should que up a compaction on loading of a region on a region server this should help keep this from happening but also we should have the split thread check to see if the region safe to split. > {code} > 2008-01-30 00:07:34,250 ERROR org.apache.hadoop.hbase.HRegionServer: Split failed for region webdata,,1201671207519 > java.io.FileNotFoundException: File hdfs://10.0.0.1:9000/gfs_storage/hadoop-root/hbase/webdata/1080614411/size/mapfiles/5351268197296217146/data does not exist. > at org.apache.hadoop.dfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:341) > at org.apache.hadoop.hbase.HStoreFile.length(HStoreFile.java:456) > at org.apache.hadoop.hbase.HStore.loadHStoreFiles(HStore.java:876) > at org.apache.hadoop.hbase.HStore.(HStore.java:731) > at org.apache.hadoop.hbase.HRegion.(HRegion.java:286) > at org.apache.hadoop.hbase.HRegion.splitRegion(HRegion.java:597) > at org.apache.hadoop.hbase.HRegionServer$Splitter.split(HRegionServer.java:303) > at org.apache.hadoop.hbase.HRegionServer$Splitter.run(HRegionServer.java:263) > {code} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.