hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1131) Using profilers other than hprof can cause JobClient to report job failure
Date Sat, 07 Nov 2009 01:15:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774524#action_12774524
] 

Todd Lipcon commented on MAPREDUCE-1131:
----------------------------------------

The idea of parsing the params seems reasonable enough, but I'm a little nervous about it.
Do we know well the specification for java command line options? Can you run multiple profilers
at once with two -javaagent params? [I'm not sure, just wondering if it's going to be just
a quick regex vs something more complicated]

> Using profilers other than hprof can cause JobClient to report job failure
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1131
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1131
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: client
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: MAPREDUCE-1131.2.patch, MAPREDUCE-1131.3.patch, MAPREDUCE-1131.patch
>
>
> If task profiling is enabled, the JobClient will download the {{profile.out}} file created
by the tasks under profile. If this causes an IOException, the job is reported as a failure
to the client, even though all the tasks themselves may complete successfully. The expected
result files are assumed to be generated by hprof. Using the profiling system with other profilers
will cause job failure.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message