hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From skaterQiang <xqfly...@163.com>
Subject Re:How to debug map reduce in distributed model
Date Wed, 29 Jun 2011 13:16:05 GMT
I hate to write these code, although it can work
      String javaOpts = conf.get("mapred.child.java.opts", "-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y");
      javaOpts = "-Xmx200m -Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y";//javaOpts.replace("@taskid@",

At 2011-06-29 20:39:35,skaterQiang <xqflying@163.com> wrote:
Hello guys:
        I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
        <value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message