hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj K (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws IllegalArgumentException
Date Mon, 24 Oct 2011 05:34:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133837#comment-13133837

Devaraj K commented on MAPREDUCE-3241:

It is reproducible with the latest trunk code. You can run the below command using the latest
job history file.

./yarn jar hadoop-mapreduce-tools-0.24.0-SNAPSHOT.jar org.apache.hadoop.tools.rumen.TraceBuilder

        -recursive <jobtrace-output> <topology-output> <inputs>

 Recently AM_STARTED event record has added in the history file, but it is not handled in
the rumen.

 public void process(HistoryEvent event) {
    } else if (event instanceof TaskUpdatedEvent) {
      processTaskUpdatedEvent((TaskUpdatedEvent) event);
    } else
      throw new IllegalArgumentException(
          "JobBuilder.process(HistoryEvent): unknown event type");

  Here for AM_STARTED record, AMStartedEvent is not able to parse and throwing the IllegalArgumentException.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>                 Key: MAPREDUCE-3241
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.24.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't
contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN  rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder
got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
within Path hdfs://
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
>         at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message