hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2877) Streaming should not throw java.lang.RuntimeException and ERROR while displaying help
Date Fri, 22 Feb 2008 13:24:19 GMT
Streaming should not throw java.lang.RuntimeException and ERROR while displaying help

                 Key: HADOOP-2877
                 URL: https://issues.apache.org/jira/browse/HADOOP-2877
             Project: Hadoop Core
          Issue Type: Improvement
          Components: contrib/streaming
            Reporter: Karam Singh
            Priority: Minor

Run streaming command as -:
bin/hadoop jar contrib/streaming/hadoop-*-streaming.jar -help 
it will dislay following -:
ERROR streaming.StreamJob: Missing required option -input
Usage: $HADOOP_HOME/bin/hadoop [--config dir] jar \
          $HADOOP_HOME/hadoop-streaming.jar [options]
  -input    <path>     DFS input file(s) for the Map step
  -output   <path>     DFS output directory for the Reduce step
  -mapper   <cmd|JavaClassName>      The streaming command to run
  -combiner <JavaClassName> Combiner has to be a Java class
  -reducer  <cmd|JavaClassName>      The streaming command to run
  -file     <file>     File/dir to be shipped in the Job jar file
  -dfs    <h:p>|local  Optional. Override DFS configuration
  -jt     <h:p>|local  Optional. Override JobTracker configuration
  -additionalconfspec specfile  Optional.
  -inputformat TextInputFormat(default)|SequenceFileAsTextInputFormat|JavaClassName Optional.
  -outputformat TextOutputFormat(default)|JavaClassName  Optional.
  -partitioner JavaClassName  Optional.
  -numReduceTasks <num>  Optional.
  -inputreader <spec>  Optional.
  -jobconf  <n>=<v>    Optional. Add or override a JobConf property
  -cmdenv   <n>=<v>    Optional. Pass env.var to streaming commands
  -mapdebug <path>  Optional. To run this script when a map task fails
  -reducedebug <path>  Optional. To run this script when a reduce task fails
  -cacheFile fileNameURI
  -cacheArchive fileNameURI

For more details about these options:
Use $HADOOP_HOME/bin/hadoop jar build/hadoop-streaming.jar -info

Exception in thread "main" java.lang.RuntimeException:
        at org.apache.hadoop.streaming.StreamJob.fail(StreamJob.java:542)
        at org.apache.hadoop.streaming.StreamJob.exitUsage(StreamJob.java:481)
        at org.apache.hadoop.streaming.StreamJob.parseArgv(StreamJob.java:203)
        at org.apache.hadoop.streaming.StreamJob.go(StreamJob.java:105)
        at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:33)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:155)

It should not display execption and -input and error about missin -input option 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message