hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Upendra Yadav <upendra1...@gmail.com>
Subject where my file stored.... what is the use of hbase.rootdir configuration
Date Fri, 21 Feb 2014 05:52:37 GMT
Sorry for that lengthy question.... :(

I have some doubt:
where my file stored(i know on datanode).... but what is the use of
hbase.rootdir configuration
i have set hbase.rootdir configuration with value : hdfs://
172.20.8.20:8020/hbase
but on startup it is not creating hbase directory so i have created my self
:

hadoop-2.2.0/hbase

And on creating lot of records by hbase with one table... i am not able to
see any files/directory inside  hadoop-2.2.0/hbase. but can able to get and
scan those records.

I think may be in memory still, so, i have restarted hbase, but still able
to get all records by java prog as well as shell... means every thing now
persistent...

but still have no files/directory inside hadoop-2.2.0/hbase

Actually for some information, i have to execute these command:

./hadoop fs -dus /hbase/
dus: DEPRECATED: Please use 'du -s' instead.
14/02/21 11:12:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
9859560264  /hbase

./hadoop fs -dus /hbase/StudentScoreCard
dus: DEPRECATED: Please use 'du -s' instead.
14/02/21 11:13:49 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
dus: `/hbase/StudentScoreCard': No such file or directory

./hadoop fs -du /hbase/StudentScoreCard
14/02/21 11:14:47 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
du: `/hbase/StudentScoreCard': No such file or directory

And my HBase Configuration is

<configuration>
<property>
<name>hbase.tmp.dir</name>
<value>/home/sas/hbase-0.98.0-hadoop2/hbase-${user.name}</value>
<description>
Temporary directory on the local filesystem
</description>
</property>
<property>
<name>hbase.local.dir</name>
        <value>${hbase.tmp.dir}/local/</value>
        <description>
         Directory on the local filesystem to be used as a local storage.
        </description>
</property>
<property>
        <name>hbase.zookeeper.quorum</name>
        <value>172.20.8.207,172.20.8.90,172.20.8.56</value>
        <description>
Comma separated list of servers in the ZooKeeper ensemble
</description>
</property>
<property>
    <name>hbase.rootdir</name>
    <value>hdfs://172.20.8.20:8020/hbase</value>
    <description>
    The directory shared by RegionServers.
    </description>
</property>
        <property>
        <name>hbase.cluster.distributed</name>
                <value>true</value>
                <description>
                The mode the cluster will be in. Possible values are
                        false: standalone and pseudo-distributed setups
with managed Zookeeper
                        true: fully-distributed with unmanaged Zookeeper
Quorum (see hbase-env.sh)
                </description>
       </property>
       <property>
      <name>hbase.zookeeper.property.dataDir</name>
                <value>${hbase.tmp.dir}/zookeeper</value>
       </property>
       <property>
                <name>hbase.zookeeper.property.clientPort</name>
                <value>2182</value>
       </property>
</configuration>




And Hadoop 2.2.0 configuration

<configuration>

<!-- Configurations for NameNode -->
<property>
<name>dfs.namenode.name.dir</name>
        <value>/home/sas/hadoop-2.2.0/fs/namenode</value>
        <description>
        Path on the local filesystem where the NameNode
        stores the namespace and transactions logs persistently.
        </description>
</property>
<property>
<name>dfs.blocksize</name>
        <value>268435456</value>
        <description>
        HDFS blocksize of 256MB for large file-systems
        </description>
        </property>
<property>
<name>dfs.namenode.handler.count</name>
        <value>100</value>
        <description>
        More NameNode server threads to handle RPCs from large number of
DataNodes.
</description>
</property>
<property>
        <name>dfs.permissions</name>
        <value>false</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
        <value>/home/sas/hadoop-2.2.0/tmp</value>
</property>

<!-- Configuration for Datanodes -->
<property>
<name>dfs.datanode.data.dir</name>
        <value>/home/sas/hadoop-2.2.0/fs/datanode</value>
        <description>
        Comma separated list of paths on the local filesystem
        of a DataNode where it should store its blocks.
</description>
</property>

</configuration>

Please help me....

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message