hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1461) Feature to instruct rumen-folder utility to skip jobs worth of specific duration
Date Fri, 05 Feb 2010 06:00:33 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Balamohan updated MAPREDUCE-1461:
----------------------------------------

    Attachment: mapreduce-1461--2010-02-05.patch

The attached patch implements this feature. User can specify  the time duration to be skipped
by specifying "-starts-after" commandline argument.

> Feature to instruct rumen-folder utility to skip jobs worth of specific duration
> --------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1461
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1461
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>             Fix For: 0.22.0
>
>         Attachments: mapreduce-1461--2010-02-05.patch
>
>
> JSON outputs of rumen on production logs can be huge in the order of multiple GB. Rumen's
folder utility helps in getting a smaller snapshot of this JSON data.
> It would be helpful to have an option in rumen-folder, wherein user can specify a duration
from which rumen-folder should start processing data.
> Related JIRA link: https://issues.apache.org/jira/browse/MAPREDUCE-1295

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message