hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Laney <mla...@hortonworks.com>
Subject Re: Issues when I run hadoop-mapreduce-examples-2.5.1.jar
Date Mon, 06 Oct 2014 01:49:37 GMT
It appears to me that  the "input" directory may not have been created.
The "hadoop jar  ..." command is expecting that it exists.  In
pseudo-distributed mode, check that you've run the command from that
website http://hadoop.apache.org/docs/current/hadoop-project-
dist/hadoop-common/SingleCluster.html
<http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html_>
  $ bin/hdfs dfs -mkdir /user/<username>
and replace <username> with huan

Mark

On Sat, Oct 4, 2014 at 4:18 AM, xiaopeng <1093218247@qq.com> wrote:

> Hi All,
>
> I install hadoop 2.5.1 on my computer as a single node cluster in
> Pseudo-Distributed mode.
>
> I followed the instructions in the web page '_http://hadoop.apache.org/
> docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html_'.
>
> It seems all right until I run mapreduce example below:
>
> huan@huan-ThinkPad-T410:~$ hadoop jar ~/hadoop-2.5.1/share/hadoop/
> mapreduce/hadoop-mapreduce-examples-2.5.1.jar grep input output
> 'dfs[a-z.]+'
> 14/10/02 21:43:42 INFO client.RMProxy: Connecting to ResourceManager at /
> 0.0.0.0:8032
> 14/10/02 21:43:43 WARN mapreduce.JobSubmitter: No job jar file set. User
> classes may not be found. See Job or Job#setJar(String).
> 14/10/02 21:43:43 INFO input.FileInputFormat: Total input paths to process
> : 30
> 14/10/02 21:43:44 INFO mapreduce.JobSubmitter: number of splits:30
> 14/10/02 21:43:44 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1412256375065_0001
> 14/10/02 21:43:45 INFO mapred.YARNRunner: Job jar is not present. Not
> adding any jar to the list of resources.
> 14/10/02 21:43:46 INFO impl.YarnClientImpl: Submitted application
> application_1412256375065_0001
> 14/10/02 21:43:46 INFO mapreduce.Job: The url to track the job:
> http://huan-ThinkPad-T410:8088/proxy/application_1412256375065_0001/
> 14/10/02 21:43:46 INFO mapreduce.Job: Running job: job_1412256375065_0001
> 14/10/02 21:44:34 INFO mapreduce.Job: Job job_1412256375065_0001 running
> in uber mode : false
>
> So please give me a guide of the problem? Thanks a lot.
>
> My configuration as below:
>
> yarn-site.xml:
> <configuration>
> <!-- Site specific YARN configuration properties -->
>     <property>
>         <name>yarn.nodemanager.aux-services</name>
>         <value>mapreduce_shuffle</value>
>     </property>
> </configuration>
>
> mapred-site.xml:
> <configuration>
>     <property>
>         <name>mapreduce.framework.name</name>
>         <value>yarn</value>
>     </property>
> </configuration>
>
> hdfs-site.xml:
> <configuration>
>     <property>
>         <name>dfs.replication</name>
>         <value>1</value>
>     </property>
> </configuration>
>
> core-site.xml:
> <configuration>
>     <property>
>         <name>fs.defaultFS</name>
>         <value>hdfs://localhost:9000</value>
>     </property>
> </configuration>
>



-- 
Mark Laney
Hortonworks
Technical Instructor
c: 720.308.8027
"Half of the world's data will be processed by Apache Hadoop within five
years"

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message