hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cliff palmer <palmercl...@gmail.com>
Subject Hadoop startup problem - directory name required
Date Mon, 23 Aug 2010 13:15:35 GMT
The namenode log for a Hadoop-0.20 installation contains this error message:
"/var/lib/hadoop-0.20/cache/hadoop/dfs/name in in an inconsistent state".
This directory does not exist and I would like to understand why this
particular directory name is required (not what the directory is used for,
but why this particular directory name).  The *-site.xml files are below (IP
addresses have been masked).
Thanks in advance for your help.
Cliff

core-site.xml:

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
        <property>
                <name>fs.default.name</name>
                <value>hdfs://xxx.xxx.xxx.xxx:8020</value>
                <final>true</final>
        </property>
        <property>
                <name>hadoop.tmp.dir</name>
                <value>/var/lib/hadoop-0.20/cache/hadoop</value>
        </property>
</configuration>
-------- end of core-site.xml -----------

hdfs-site.xml:

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
        <property>
                <name>dfs.replication</name>
                <value>3</value>
        </property>
        <property>
                <name>dfs.name.dir</name>
                <value>/DFS/dfsname,/var/lib/hadoop-0.20/dfsname</value>
        <property>
        </property>
                <name>dfs.data.dir</name>
                <value>/DFS1/dfsdata,/DFS2/dfsdata,/DFS3/dfsdata</value>
        </property>
        <property>
                <name>dfs.permissions</name>
                <value>false</value>
        </property>
        <property>
                <name>dfs.datanode.du.reserved</name>
                <value>20000000000</value>
        </property>
        <property>
                <name>dfs.namenode,plugins</name>
                <value>org.apache.hadoop.thriftfs.NamenodePlugin</value>
        </property>
        <property>
                <name>dfs.datanode.plugins</name>
                <value>org.apache.hadoop.thriftfs.DatanodePlugins</value>
        </property>
        <property>
                <name>dfs.thrift.address</name>
                <value>0.0.0.0:9090</value>
        </property>
</configuration>
-------- end of core-site.xml -----------

mapred-site.xml:

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
        <property>
                <name>mapred.job.tracker</name>
                <value>xxx.xxx.xxx.xxx:8020</value>
        </property>
        <property>
                <name>jobtracker.thrift.address</name>
                <value>0.0.0:9290</value>
        </property>
        <property>
                <name>mapred.jobtracker.plugins</name>

<value>org.apache.hadoop.thriftfs.ThriftJobTrackerPlugin</value>
        </property>
</configuration>
-------- end of core-site.xml -----------

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message