hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-1461) Feature to instruct rumen-folder utility to skip jobs worth of specific duration
Date Thu, 28 Apr 2011 04:26:03 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amar Kamat updated MAPREDUCE-1461:
----------------------------------

             Tags: rumen, folder, skip-jobs
       Resolution: Fixed
    Fix Version/s: 0.23.0
         Assignee: Rajesh Balamohan
     Release Note: Added a ''-starts-after' option to Rumen's Folder utility. The time duration
specified after the '-starts-after' option is an offset with respect to the submit time of
the first job in the input trace. Jobs in the input trace having a submit time (relative to
the first job's submit time) lesser than the specified offset will be ignored.
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I just committed this. Thanks Rajesh!

> Feature to instruct rumen-folder utility to skip jobs worth of specific duration
> --------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1461
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1461
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: tools/rumen
>    Affects Versions: 0.23.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>             Fix For: 0.23.0
>
>         Attachments: MR-1461-trunk.patch, mapreduce-1461--2010-02-05.patch, mapreduce-1461--2010-03-04.patch,
mr-1461-trunk-with-testcases.patch
>
>
> JSON outputs of rumen on production logs can be huge in the order of multiple GB. Rumen's
folder utility helps in getting a smaller snapshot of this JSON data.
> It would be helpful to have an option in rumen-folder, wherein user can specify a duration
from which rumen-folder should start processing data.
> Related JIRA link: https://issues.apache.org/jira/browse/MAPREDUCE-1295

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message