hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "HowToDebugMapReducePrograms" by ChristopheTaton
Date Sun, 17 Feb 2008 11:30:47 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by ChristopheTaton:
http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms

------------------------------------------------------------------------------
  The script file needs to be symlinked.
  
  This property can also be set by APIs 
- [http://lucene.apache.org/hadoop/api/org/apache/hadoop/filecache/DistributedCache.html#addCacheFile(java.net.URI,%20org.apache.hadoop.conf.Configuration)
DistributedCache.addCacheFile(URI,conf)] and [http://lucene.apache.org/hadoop/api/org/apache/hadoop/filecache/DistributedCache.html#setCacheFiles
DistributedCache.setCacheFiles(URIs,conf)] where URI is of the form "hdfs://host:port/<absolutepath>#<script-name>".
+ [http://hadoop.apache.org/core/api/org/apache/hadoop/filecache/DistributedCache.html#addCacheFile(java.net.URI,%20org.apache.hadoop.conf.Configuration)
DistributedCache.addCacheFile(URI,conf)] and [http://hadoop.apache.org/core/api/org/apache/hadoop/filecache/DistributedCache.html#setCacheFiles
DistributedCache.setCacheFiles(URIs,conf)] where URI is of the form "hdfs://host:port/<absolutepath>#<script-name>".
  For Streaming, the file can be added through command line option -cacheFile.
- To create symlink for the file, the property "mapred.create.symlink" is set to "yes". This
can also be set by [http://lucene.apache.org/hadoop/api/org/apache/hadoop/filecache/DistributedCache.html#createSymlink(org.apache.hadoop.conf.Configuration)
DistributedCache.createSymLink]
+ To create symlink for the file, the property "mapred.create.symlink" is set to "yes". This
can also be set by [http://hadoop.apache.org/core/api/org/apache/hadoop/filecache/DistributedCache.html#createSymlink(org.apache.hadoop.conf.Configuration)
DistributedCache.createSymLink]
  
  Here is an example on how to submit a script 
  {{{

Mime
View raw message