hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Alkahtani <m.alkaht...@gmail.com>
Subject Re: Hadoop Debian Package
Date Sun, 17 Mar 2013 17:25:42 GMT
I followed it but he used the binary package not Debian 

Regards,
Mohammad Alkahtani


On 17 Mar 2013, at 08:11 PM, Jean-Marc Spaggiari <jean-marc@spaggiari.org> wrote:

> Hi Mohammad,
> 
> Maybe you can take a look here and see if anything apply to you?
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
> you might be able to directly jump to the configuration section...
> 
> JM
> 
> 2013/3/17 Mohammad Alkahtani <m.alkahtani@gmail.com>:
>> Hi to all users of Hadoop,
>> 
>> I installed Hadoop the .deb file on Ubuntu 12.04 but I might could not
>> configure it right. The conf dir is under templates in /usr/shar/hadoop. I
>> edit the core-site.xml, mapred-site.xml files to give
>> <property>
>> <name>fs.default.name</name>
>> <value>hdfs://localhost:9000</value>
>> </property>
>> and for mapred
>> <property>
>> <name>mapred.job.tracker</name>
>> <value>localhost:9001</value>
>> </property>
>> 
>> but i get these errors, I assume that there is problem, Hadoop cannot read
>> the configuration file.
>> I chaned the hadoop-env.sh to
>> export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/usr/shar/hadoop/templates/conf"}
>> but dosen't solve the problem.
>> 
>> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
>> java.lang.IllegalArgumentException: Does not contain a valid host:port
>> authority: file:/// at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:201)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:231)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:225)
>> at
>> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:347)
>> at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:309) at
>> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1651)
>> at
>> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1590)
>> at
>> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1608)
>> at
>> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1734)
>> at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1751)
>> 
>> ________________________________
>> 
>> FATAL org.apache.hadoop.mapred.JobTracker:
>> java.lang.IllegalArgumentException: Does not contain a valid host:port
>> authority: local at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:130) at
>> org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2312) at
>> org.apache.hadoop.mapred.JobTracker.(JobTracker.java:2070) at
>> org.apache.hadoop.mapred.JobTracker.(JobTracker.java:1889) at
>> org.apache.hadoop.mapred.JobTracker.(JobTracker.java:1883) at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:312) at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:303) at
>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:298)
>> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4791)
>> 
>> ________________________________
>> 
>> ERROR org.apache.hadoop.hdfs.server.namenode.NameNode:
>> java.lang.IllegalArgumentException: Does not contain a valid host:port
>> authority: file:/// at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:201)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:231)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:265)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:536) at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1410)
>> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1419)
>> 
>> ________________________________
>> 
>> Exception in thread "main" java.lang.IllegalArgumentException: Does not
>> contain a valid host:port authority: file:/// at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:201)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:231)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:225)
>> at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:167)
>> at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.(SecondaryNameNode.java:135)
>> at
>> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:650)
>> 
>> ________________________________
>> 
>> ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker
>> because java.lang.IllegalArgumentException: Does not contain a valid
>> host:port authority: local at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:164) at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:130) at
>> org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2312) at
>> org.apache.hadoop.mapred.TaskTracker.(TaskTracker.java:1532) at
>> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3906)
>> 
>> 
>> Regards,
>> Mohammad Alkahtani

Mime
View raw message