hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Joshi <ravi.josh...@yahoo.com>
Subject Re: Unable to work with Hadoop 1.0.1 using eclipse-indigo
Date Thu, 17 May 2012 15:07:18 GMT
Now i added all the jar files which came up with hadoop-1.0.1.tar.gz package. But some new
errors are showing. This time i am following wordCount v2 (http://hadoop.apache.org/common/docs/current/mapred_tutorial.html#Example%3a+WordCount+v2.0).
Following is the error.

12/05/17 20:31:43 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
12/05/17 20:31:43 WARN mapred.JobClient: No job jar file set.  User classes may not be found.
See JobConf(Class) or JobConf#setJar(String).
12/05/17 20:31:43 INFO mapred.JobClient: Cleaning up the staging area file:/tmp/hadoop-hduser/mapred/staging/hduser-481041798/.staging/job_local_0001
12/05/17 20:31:43 ERROR security.UserGroupInformation: PriviledgedActionException as:hduser
cause:org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/home/hduser/Desktop/Eclipse_Workspace/K-Means
Algorithm/~/Desktop/input/doc
Exception in thread "main" org.apache.hadoop.mapred.InvalidInputException: Input path does
not exist: file:/home/hduser/Desktop/Eclipse_Workspace/K-Means Algorithm/~/Desktop/input/doc
    at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:197)
    at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:208)
    at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:989)
    at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:981)
    at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:897)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:416)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
    at test.WordCount.run(WordCount.java:131)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at test.WordCount.main(WordCount.java:136)


-Ravi Joshi

--- On Thu, 17/5/12, Ravi Joshi <ravi.joshi53@yahoo.com> wrote:

From: Ravi Joshi <ravi.joshi53@yahoo.com>
Subject: Re: Unable to work with Hadoop 1.0.1 using eclipse-indigo
To: common-user@hadoop.apache.org
Received: Thursday, 17 May, 2012, 2:16 PM

Hi, i added hadoop-core-1.0.1.jar in the project class path. i am testing wordcount (http://hadoop.apache.org/common/docs/current/mapred_tutorial.html#Example%3A+WordCount+v1.0)
but when i try to run my WordCount.java in eclipse, it shows the following errors-


Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory
    at org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:143)
    at test.WordCount.main(WordCount.java:56)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
    at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
    ... 2 more 

-Ravi Joshi

--- On Thu, 17/5/12, Ravi Joshi <ravi.joshi53@yahoo.com> wrote:

From: Ravi Joshi <ravi.joshi53@yahoo.com>
Subject: Re: Unable to work with Hadoop 1.0.1 using eclipse-indigo
To: common-user@hadoop.apache.org
Received: Thursday, 17 May, 2012, 1:37 PM

Hi Jagat, Thank you so much for answering the question. Can you please tell me all the names
with location of jar files, which must be added in the project? I am using hadoop-1.0.1 in
Eclipse Indigo on Ubuntu10.04 LTS.
Thank you.

-Ravi Joshi

--- On Thu, 17/5/12, Jagat <jagatsingh@gmail.com> wrote:

From: Jagat <jagatsingh@gmail.com>
Subject: Re: Unable to work with Hadoop 1.0.1 using eclipse-indigo
To: common-user@hadoop.apache.org
Received: Thursday, 17 May, 2012, 1:32 PM

Hello Ravi

To create map reduce programs plugin is not mandatory.

Just download Hadoop
Create one Java project in Eclipse
Add jar files from Home folder of Hadoop ( from share folder in Hadoop 2.x
) to project class path
Create new mapper class and Reducer class , Driver class
Run it





On Thu, May 17, 2012 at 6:48 PM, Ravi Joshi <ravi.joshi53@yahoo.com> wrote:

> Hi, i recently downloaded and successfully installed hadoop-1.0.1 in my
> ubuntu 10.04 LTS. I have hadoop-1.0.1.tar.gz downloaded and now i want
> to design map-reduce application. As suggested by some blogs, first we
> should install eclipse plugin for hadoop, which is located inside
> contrib->eclipse plugin but in my hadoop-1.0.1.tar.gz, inside contrib
>  directory no eclipse plugin is found. Inside contrib directory only
> datajoin, failmon, gridmix, hdfsproxy, hod, index, streaming and vaidya
> directories are present. when i looked over src->contrib, i can find
> eclipse plugin directory but no jar file.
> I haven't work with hadoop
> under eclipse before, can somebody please explain me the plugin
> installation, so that i can start map-reduce development.
> Thanking you.
>
> -Ravi Joshi

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message