hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shrinivas Joshi <jshrini...@gmail.com>
Subject JIT debug symbols and OProfile under Hadoop
Date Wed, 16 Jun 2010 22:53:06 GMT

I am trying to get profiles for a workload running on top of Hadoop 0.20.2
framework. The workload jars and Hadoop jars have been compiled with debug
symbols enabled. I could see local variable tables and line number tables in
the jar class files using javap. I am passing the right value for *agentpath
* flag pointing to oprofile JVMTI agent and I am also seeing it passed
correctly to map and reduce JVMs from *ps *output. This is done through
conf/mapred-site.xml properties. However, in the profiles I am unable to see
meaningful samples for JITed code; everything is getting attributed to anon

Profiling a test app works just fine with the same JVM that is being used by
Hadoop. I can see the right debug symbols being attributed in the resulting
profiling. In fact, I even tried profiling a JVM process that was spawned
using *ProcessBuilder* API, the way Hadoop spawns its map and reduce JVMs,
that seem to work fine too.

Does anybody have any pointers as to what I might be missing here? Has
anybody successfully collected profiles showing JIT debug symbols for any
Hadoop workload? I am using OProfile 0.9.6.



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message