hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "WordCount" by JoeMontanez
Date Thu, 04 Sep 2008 16:58:52 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by JoeMontanez:
http://wiki.apache.org/hadoop/WordCount

The comment on the change is:
bin/hadoop dfs -copyFromLocal <local-dir> <hdfs-dir> will create <hdfs-dir>

------------------------------------------------------------------------------
  bin/hadoop jar hadoop-*-examples.jar wordcount [-m <#maps>] [-r <#reducers>]
<in-dir> <out-dir>
  
  All of the files in the input directory (called in-dir in the command line above) are read
and the counts of words in the input are written to the output directory (called out-dir above).
 It is assumed that both inputs and outputs are stored in HDFS (see ImportantConcepts).  If
your input is not already in HDFS, but is rather in a local file system somewhere, you need
to copy the data into HDFS using a command like this:[[BR]]
+ 
  bin/hadoop dfs -mkdir <hdfs-dir>
  bin/hadoop dfs -copyFromLocal <local-dir> <hdfs-dir>
  
+ As of version 0.17.2.1, use a command like this:
+ bin/hadoop dfs -copyFromLocal <local-dir> <hdfs-dir>
+ 
+ 
  Word count supports generic options : see DevelopmentCommandLineOptions
  

Mime
View raw message