Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 414077160 for ; Mon, 12 Sep 2011 17:34:05 +0000 (UTC) Received: (qmail 41790 invoked by uid 500); 12 Sep 2011 17:34:03 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 41721 invoked by uid 500); 12 Sep 2011 17:34:03 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 41713 invoked by uid 99); 12 Sep 2011 17:34:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Sep 2011 17:34:03 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of parmod.mehta@gmail.com designates 209.85.161.41 as permitted sender) Received: from [209.85.161.41] (HELO mail-fx0-f41.google.com) (209.85.161.41) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Sep 2011 17:33:56 +0000 Received: by fxh17 with SMTP id 17so2400924fxh.14 for ; Mon, 12 Sep 2011 10:33:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=buSXl5HlX7TLSMcsqI92h65GcAXJD6x6wvnyQnZk6yE=; b=P8HfB1KOY6sOVE1GGbwv11ifSBUaglzGgIsou+Lyzv8oKlJTsrdaa+lbS4lJbQCCUt SMc0/6eTSeWfZCCeH672Olzg4ro1rY+DBOwPtymnsJyQ6XCynemuEFOodsBiuTvyHmcr 62hpYxg8B+pYtj9rKmrBLRqItxy7reAaI25vI= MIME-Version: 1.0 Received: by 10.223.49.11 with SMTP id t11mr546729faf.57.1315848816170; Mon, 12 Sep 2011 10:33:36 -0700 (PDT) Received: by 10.223.108.82 with HTTP; Mon, 12 Sep 2011 10:33:35 -0700 (PDT) Date: Mon, 12 Sep 2011 10:33:35 -0700 Message-ID: Subject: HBase region merge problem From: Parmod Mehta To: user@hbase.apache.org Cc: search@decarta.com Content-Type: multipart/alternative; boundary=001517475f1844172204acc1edbe X-Virus-Checked: Checked by ClamAV on apache.org --001517475f1844172204acc1edbe Content-Type: text/plain; charset=ISO-8859-1 Running the merge tool to merge regions on hbase-0.90.1-cdh3u0 run into this exception trace. The first INFO level log message I guess is ok (checking if the cluster is down). Not sure - why we running into this? bug? java.lang.IllegalArgumentException: Wrong FS: hdfs:// internalhost.com:54310/hbase/-ROOT-/70236052/.regioninfo, expected: file:/// 2011-09-12 10:21:38,364 INFO [main] util.Merge(82): Verifying that file system is available... 2011-09-12 10:21:38,370 INFO [main] util.Merge(91): Verifying that HBase is not running... 2011-09-12 10:21:38,576 INFO [main] client.HConnectionManager$HConnectionImplementation(355): ZooKeeper available but no active master location found 2011-09-12 10:21:38,578 INFO [main] client.HConnectionManager$HConnectionImplementation(372): getMaster attempt 0 of 1 failed; no more retrying. org.apache.hadoop.hbase.MasterNotRunningException at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:356) at org.apache.hadoop.hbase.client.HBaseAdmin.(HBaseAdmin.java:90) at org.apache.hadoop.hbase.client.HBaseAdmin.checkHBaseAvailable(HBaseAdmin.java:1202) at org.apache.hadoop.hbase.util.Merge.run(Merge.java:93) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379) 2011-09-12 10:21:38,913 INFO [main] util.Merge(199): Merging regions TABLE_2,ERSx0973541,1305737576487.c0a59ee581f619456c962227073f9dd6. and TABLE_2,LEx09136249,1305737576487.85f0adaeb78d362596ea8d178bda5629. in table TABLE_2 2011-09-12 10:21:38,940 INFO [main] wal.HLog(364): HLog configuration: blocksize=32 MB, rollsize=30.4 MB, enabled=true, flushlogentries=1, optionallogflushinternal=1000ms 2011-09-12 10:21:39,016 WARN [main] util.NativeCodeLoader(52): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2011-09-12 10:21:39,602 INFO [main] wal.SequenceFileLogWriter(126): Using syncFs -- HDFS-200 2011-09-12 10:21:39,605 INFO [main] wal.HLog(510): New hlog /home/pmehta/.logs_1315848098931/hlog.1315848098940 2011-09-12 10:21:39,606 INFO [main] wal.HLog(396): getNumCurrentReplicas--HDFS-826 not available; hdfs_out=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer@3a289d2e, exception=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.getNumCurrentReplicas() 2011-09-12 10:21:39,631 FATAL [main] util.Merge(114): Merge failed java.lang.IllegalArgumentException: Wrong FS: hdfs:// internalhost.com:54310/hbase/-ROOT-/70236052/.regioninfo, expected: file:/// at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:410) at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:56) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:379) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251) at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:748) at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:408) at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:337) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2546) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2532) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2501) at org.apache.hadoop.hbase.util.MetaUtils.openRootRegion(MetaUtils.java:269) at org.apache.hadoop.hbase.util.MetaUtils.scanRootRegion(MetaUtils.java:201) at org.apache.hadoop.hbase.util.Merge.mergeTwoRegions(Merge.java:204) at org.apache.hadoop.hbase.util.Merge.run(Merge.java:110) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379) 2011-09-12 10:21:39,634 INFO [main.logSyncer] wal.HLog$LogSyncer(973): main.logSyncer exiting 2011-09-12 10:21:39,640 ERROR [main] util.Merge(381): exiting due to error java.lang.IllegalArgumentException: Wrong FS: hdfs:// internalhost.com:54310/hbase/.META./1028785192/.regioninfo, expected: file:/// at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:410) at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:56) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:379) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251) at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:748) at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:408) at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:337) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2546) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2532) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2501) at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276) at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261) at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379) thanks --001517475f1844172204acc1edbe--