hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time
Date Tue, 04 Sep 2012 18:21:08 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13447886#comment-13447886
] 

Karthik Kambatla commented on MAPREDUCE-4629:
---------------------------------------------

>From my conversation with Alejandro offline:

More context:
- The regular mode cleans up the history files after a month. The history filenames use yyyy/mm/dd.
- The debug mode cleans up the history files after 20 minutes. The history filenames (currently)
use yyyy/hour/min.

The DEBUG_MODE overloads the regular mode. Instead, a better approach seems to be to append
to the regular mode, instead of overloading it.

Also, the config parameter to turn the DEBUG_MODE on/off mapreduce.jobhistory.debug.mode doesn't
have a default in mapred-default.xml and needs to be added.
                
> In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time
> ----------------------------------------------------------------
>
>                 Key: MAPREDUCE-4629
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4629
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.0.3
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>         Attachments: MR-4629.patch
>
>
> The helper methods in JobHistory - directoryTime() and timestampDirectoryComponent()
- adjust the month field for readability (Jan is 0 as per Calendar, 1 for us)
> In DEBUG_MODE, JobHistory uses hour instead of month. However, the adjustment is still
applied.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message