hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jimmy Wan <ji...@indeed.com>
Subject Profiling with Hadoop
Date Wed, 01 Apr 2009 23:55:51 GMT
I'm trying to profile my map/reduce processes under Hadoop 0.17.2.
>From looking at the hadoop-default.xml, the property
"mapred.task.profile.params" did not yet exist back then, so I'm
trying to add to the property "mapred.child.java.opts" with
-Xmx512m -verbose:gc

The resulting JVMs won't have the hprof parameters when I look at them
via PS, the files are never created and there is no mention of dumping
stats in the logs.

Am I missing something?

I'd switch to 0.19.1, but I haven't had time to setup a migration plan
for my data yet.

Jimmy Wan

View raw message