hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "HowToDebugMapReducePrograms" by Amareshwari
Date Thu, 11 Oct 2007 12:34:32 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by Amareshwari:
http://wiki.apache.org/lucene-hadoop/HowToDebugMapReducePrograms

------------------------------------------------------------------------------
  == How to submit debug script ==
  
  A quick way to set debug script is to set the properties "mapred.map.task.debug.script"
and "mapred.reduce.task.debug.script" for debugging map task and reduce task respectively.
These properties can also be set by APIs conf.setMapDebugScript(String script) and conf.setReduceDebugScript(String
script).
+ The debug command is run as $script $stdout $stderr $syslog $jobconf. Task's stdout, stderr,
syslog and jobconf files can be accessed inside the script as $1, $2, $3 and $4. In case of
streaming, debug script can be submitted with command-line options -mapdebug, -reducedebug
for debugging mapper and redcuer respectively.
- The debug command is run as $script $stdout $stderr $syslog. Task's stdout, stderr and syslog
files can be accessed inside the script as $1, $2 and $3.
- In case of streaming, debug script can be submitted with command-line options -mapdebug,
-reducedebug for debugging mapper and redcuer respectively.
  
  To submit the debug script file, first put the file in dfs.
  Make sure the property "mapred.create.symlink" is set to "yes". This can also be set by
[http://lucene.apache.org/hadoop/api/org/apache/hadoop/filecache/DistributedCache.html#createSymlink(org.apache.hadoop.conf.Configuration)
DistributedCache.createSymLink]

Mime
View raw message