hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From praveenesh kumar <praveen...@gmail.com>
Subject Re: org.apache.hadoop.mapred.InvalidInputException ??
Date Mon, 25 Apr 2011 06:34:16 GMT
Hi,
I am able to run hadoop map-reduce wordcount example on my linux machine..
Means my hadoop settings are correct on my linux machine..
I don't know about valid path you are talking about ?? where to set this
thing ??




On Mon, Apr 25, 2011 at 11:58 AM, Harsh J <harsh@cloudera.com> wrote:

> Do you have a valid path /user/hadoop/In (it must be a file, or a
> directory with files)?
>
> On Mon, Apr 25, 2011 at 11:32 AM, praveenesh kumar <praveenesh@gmail.com>
> wrote:
> > Hi,
> >
> > I am new to hadoop and the scenario is like this :
> >
> > I have hadoop installed on a linux machine having IP as (162.192.100.46)
> > and I have another window machine with eclipse and hadoop plugin
> installed..
> > I am able to connect to linux hadoop machine and can see the dfs location
> > and mapred folder using my plugin. I copied all the hadoop jar files from
> > linux to windows and set them in my eclipse.
> >
> > I am trying to run a sample small code from windows to the linux hadoop
> > machine
> >
> > Code :
> >
> > import org.apache.hadoop.fs.Path;
> > import org.apache.hadoop.io.IntWritable;
> > import org.apache.hadoop.io.Text;
> > import org.apache.hadoop.mapred.FileInputFormat;
> > import org.apache.hadoop.mapred.FileOutputFormat;
> > import org.apache.hadoop.mapred.JobClient;
> > import org.apache.hadoop.mapred.JobConf;
> > import org.apache.hadoop.mapred.Mapper;
> > import org.apache.hadoop.mapred.Reducer;
> > import org.apache.hadoop.mapred.TextInputFormat;
> > import org.apache.hadoop.mapred.TextOutputFormat;
> >
> > public class TestDriver {
> >
> >  public static void main(String[] args) {
> >  JobClient client = new JobClient();
> >  JobConf conf = new JobConf(TestDriver.class);
> >
> >  // TODO: specify output types
> >  conf.setOutputKeyClass(Text.class);
> >  conf.setOutputValueClass(IntWritable.class);
> >  // TODO: specify input and output DIRECTORIES (not files)
> >  //conf.setInputPath(new Path("src"));
> >  //conf.setOutputPath(new Path("out"));
> >
> >  conf.setInputFormat(TextInputFormat.class);
> >  conf.setOutputFormat(TextOutputFormat.class);
> >
> >
> >
> >  FileInputFormat.setInputPaths(conf, new Path("In"));
> >  FileOutputFormat.setOutputPath(conf, new Path("Out"));
> >
> >
> >  // TODO: specify a mapper
> >  conf.setMapperClass(org.apache.hadoop.mapred.lib.IdentityMapper.class);
> >
> >  // TODO: specify a reducer
> >
>  conf.setReducerClass(org.apache.hadoop.mapred.lib.IdentityReducer.class);
> >
> >  client.setConf(conf);
> >  try {
> >   JobClient.runJob(conf);
> >  } catch (Exception e) {
> >   e.printStackTrace();
> >  }
> >  }
> > }
> >
> >
> >
> > Whenever I am trying to run the code on eclipse plugin ..
> > I am getting the following error :
> >
> >
> > *11/04/25 13:39:16 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> > processName=JobTracker, sessionId=*
> >
> > *11/04/25 13:39:16 WARN mapred.JobClient: Use GenericOptionsParser for
> > parsing the arguments. Applications should implement Tool for the same.*
> > *
> >
> > org.apache.hadoop.mapred.InvalidInputException**: Input path does not
> exist:
> > hdfs://162.192.100.46:54310/user/hadoop/In*
> >
> > *at org.apache.hadoop.mapred.FileInputFormat.listStatus(**
> > FileInputFormat.java:190**)*
> >
> > *at org.apache.hadoop.mapred.FileInputFormat.getSplits(**
> > FileInputFormat.java:201**)*
> >
> > *at
> org.apache.hadoop.mapred.JobClient.writeOldSplits(**JobClient.java:810**
> > )*
> >
> > *at org.apache.hadoop.mapred.JobClient.submitJobInternal(**
> > JobClient.java:781**)*
> >
> > *at org.apache.hadoop.mapred.JobClient.submitJob(**JobClient.java:730**)*
> >
> > *at org.apache.hadoop.mapred.JobClient.runJob(**JobClient.java:1249**)*
> >
> > *at TestDriver.main(**TestDriver.java:46**)*
> > I know I am doing something wrong, Can anyone tell me where I am wrong,
> and
> > how can I run my code from windows to that linux hadoop machine.
> >
> > Thanks,
> > Praveenesh
> >
>
>
>
> --
> Harsh J
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message