hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ranjit Mathew (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2078) TraceBuilder unable to generate the traces while giving the job history path by globing.
Date Mon, 20 Sep 2010 11:30:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12912439#action_12912439
] 

Ranjit Mathew commented on MAPREDUCE-2078:
------------------------------------------

Some minor comments:
* In ??If the input is a file then its directly?? in the comment to {{processInput()}}, change
"its" to "it's" or "it is".
* Just use plain old JavaDoc style comments for {{processInput()}}.
* In {{processInput()}}, you can now directly use the {{FileStatus}} object {{inStatus}} instead
of calling {{fs.getFileStatus()}} again.

> TraceBuilder unable to generate the traces while giving the job history path by globing.
> ----------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2078
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2078
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>            Reporter: Vinay Kumar Thota
>            Assignee: Amar Kamat
>         Attachments: mapreduce-2078-v1.2.patch
>
>
> I was trying to generate the traces for MR job histories by using TraceBuilder. However,
it's unable to generate the traces while giving the job history path by globing. It throws
a file not found exception even though the job history path is exists.
> I have provide the job history path in the below way.
> hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*/
> Exception:
> java.io.FileNotFoundException: File does not exist:
> hdfs://<<clustername>>/dir1/dir2/dir3/*/*/*/*/*/*
>         at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:525)
>         at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:88)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:183)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:121)
> It's truncating the last  slash in the path.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message