hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shailesh Samudrala <shailesh2...@gmail.com>
Subject Re: need help regarding eclipse plugin for hadoop
Date Mon, 19 Mar 2012 16:46:52 GMT

On top of the Hadoop eclipse plugin, you already need to have a Hadoop
Virtual Machine, where eclipse can run the code, and a local library of
hadoop, which will be used by Eclipse to compile your code.
Below are the steps that I used to run a sample wordcount example on the
Hadoop VM.
1. Download this virtual appliance:

Also, download a relevant version of hadoop onto your computer, you will
need to provide the path to the hadoop library to Eclipse.

2. Login using: hadoop-user, pwd: hadoop

3. Try this command: hadoop dfs -ls
if you get an error, then use this command
kinit -k -t /home/hadoop-user/hadoop-user.keytab

This will setup your Hadoop VM

Next, to install the plugin on eclipse,

1. Download this plugin, and place it in the plugin directory in eclipse

2. Use the steps mentioned here to configure the plugin in eclipse:

Host id is the IP address that is printed on VM startup
Hadoop directory: /home/hadoop-user/hadoop

3. Create input directory in hadoop DFS, which will be input directory for
map reduce, and create a text file which will be the input file.

a) vi temp.txt
b) mkdir input
c) mv temp.txt input/temp.txt
d) hadoop dfs copyFromLocal input .
e) mkdir output
f) hadoop dfs copyFromLoacl output .

4. Then run the code attached on the hadoop server, if it runs
successfully, the output will be stored in the output directory.
a) vi output/part-r-00000

On Mon, Mar 19, 2012 at 12:29 PM, tabraiz anwer <tabraizanwer@yahoo.com>wrote:

> Hi,
>      I am newbie to the hadoop, and trying to configure eclipse plugin of
> hadoop but its resposnse is very awkward and giving me the error.
> Error : Unable to login. when trying to connect to hadoop DFS  using
> Hadoop plugin for eclipse
> using hadoop : hadoop-
> eclipse plugin : hadoop-eclipse-plugin-
> eclipse : eclipse indigo
> using Ubuntu 11.04 64bit.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message