hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary
Date Tue, 26 Jan 2016 21:57:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118136#comment-15118136
] 

Jason Lowe commented on MAPREDUCE-6613:
---------------------------------------

I have no issues with this going into 3.0.  I agree with Allen that there are use cases today
where people have built pipelines that consume the jhist files, so therefore it's risky to
change the default in anything before 3.x.


> Change mapreduce.jobhistory.jhist.format default from json to binary
> --------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6613
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6613
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>    Affects Versions: 2.8.0
>            Reporter: Ray Chiang
>            Assignee: Ray Chiang
>            Priority: Minor
>         Attachments: MAPREDUCE-6613.001.patch
>
>
> MAPREDUCE-6376 added a configuration setting to set up .jhist internal format:
> mapreduce.jobhistory.jhist.format
> Currently, the default is "json".  Changing the default to "binary" allows faster parsing,
but with the downside of making the file not output friendly by using "hadoop fs cat".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message