Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 9 May 2012 17:13:50 +0000 (UTC)
From: "Jonathan Hsieh (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: 
 <1185903371.45328.1336583630117.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1403932184.143.1335346082171.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HBASE-5874) The HBase do not configure the
 'fs.default.name' attribute, the hbck tool and Merge tool throw
 IllegalArgumentException.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271609#comment-13271609 ] 

Jonathan Hsieh commented on HBASE-5874:
---------------------------------------

Fulin, 

The latest version still doesn't address the issue I brought up:

Look at what should be fs.defaultFS here: http://hadoop.apache.org/common/docs/current/core-default.html

I think the code I'm concerned about should be something like this:
{code}
    Path hbasedir = new Path(conf.get(HConstants.HBASE_DIR));
    URI defaultFs = hbasedir.getFileSystem(conf).getUri();
    conf.set("fs.defaultFS", defaultFs.toString());     // for hadoop 0.21+
    conf.set("fs.default.name", defaultFs.toString());  // for hadoop 0.20
{code}

for Merge, it might be good to make the -D option look optional or have a place holder for <-Doptions> where you put the example and add some lines further down with a quick mention of  -Dfs.defaultFs for hadoop 0.21+ or -Dfs.default.name for 0.20.

Thanks,
Jon.
                
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-5874
>                 URL: https://issues.apache.org/jira/browse/HBASE-5874
>             Project: HBase
>          Issue Type: Bug
>          Components: hbck
>    Affects Versions: 0.90.6
>            Reporter: fulin wang
>            Assignee: fulin wang
>         Attachments: HBASE-5874-0.90-v2.patch, HBASE-5874-0.90.patch, HBASE-5874-trunk-v2.patch, HBASE-5874-trunk.patch
>
>
> The HBase do not configure the 'fs.default.name' attribute, the hbck tool and Merge tool throw IllegalArgumentException.
> the hbck tool and Merge tool, we should add 'fs.default.name' attriubte to the code.
> hbck exception:
> Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:128)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:301)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:489)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegioninfo(HBaseFsck.java:565)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionInfos(HBaseFsck.java:596)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:332)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:360)
> 	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:2907)
>     
> Merge exception:  
> [2012-05-05 10:48:24,830] [ERROR] [main] [org.apache.hadoop.hbase.util.Merge 381] exiting due to error
> java.lang.IllegalArgumentException: Wrong FS: hdfs://160.176.0.101:9000/hbase/.META./1028785192/.regioninfo, expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:412)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:59)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:382)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:285)
> 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:823)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.checkRegioninfoOnFilesystem(HRegion.java:415)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:340)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2679)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2665)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2634)
> 	at org.apache.hadoop.hbase.util.MetaUtils.openMetaRegion(MetaUtils.java:276)
> 	at org.apache.hadoop.hbase.util.MetaUtils.scanMetaRegion(MetaUtils.java:261)
> 	at org.apache.hadoop.hbase.util.Merge.run(Merge.java:115)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.hbase.util.Merge.main(Merge.java:379)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira