hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1978) [Rumen] TraceBuilder should provide recursive input folder scanning
Date Tue, 23 Nov 2010 17:44:14 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934923#action_12934923
] 

Ravi Gummadi commented on MAPREDUCE-1978:
-----------------------------------------

find and awk actually are doing the work correctly and we want to compare that behavior against
the main code changes of this patch. It is validating lot of things like (1) globbed path
given to fs.globStatus() (2) fs.listFiles() with and without -recursive option and (3) sorting
of filenames alone instead of sorting the whole paths.

Ran "ant test" now. Tests passed.

> [Rumen] TraceBuilder should provide recursive input folder scanning
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1978
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1978
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tools/rumen
>            Reporter: Amar Kamat
>            Assignee: Ravi Gummadi
>         Attachments: 1978.patch, 1978.v1.patch
>
>
> Currently, {{TraceBuilder}} assumes that the input is either jobhistory files or a folders
containing jobhistory files directly underneath the specified folder. There could be a use
cases where the input folder could contain sub-folders containing jobhistory files. Rumen
should support such input folders.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message