Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <7750191.265041290534254806.JavaMail.jira@thor>
Date: Tue, 23 Nov 2010 12:44:14 -0500 (EST)
From: "Ravi Gummadi (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-1978) [Rumen] TraceBuilder should
 provide recursive input folder scanning
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934923#action_12934923 ] 

Ravi Gummadi commented on MAPREDUCE-1978:
-----------------------------------------

find and awk actually are doing the work correctly and we want to compare that behavior against the main code changes of this patch. It is validating lot of things like (1) globbed path given to fs.globStatus() (2) fs.listFiles() with and without -recursive option and (3) sorting of filenames alone instead of sorting the whole paths.

Ran "ant test" now. Tests passed.

> [Rumen] TraceBuilder should provide recursive input folder scanning
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1978
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1978
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tools/rumen
>            Reporter: Amar Kamat
>            Assignee: Ravi Gummadi
>         Attachments: 1978.patch, 1978.v1.patch
>
>
> Currently, {{TraceBuilder}} assumes that the input is either jobhistory files or a folders containing jobhistory files directly underneath the specified folder. There could be a use cases where the input folder could contain sub-folders containing jobhistory files. Rumen should support such input folders.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.