hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-980) Modify JobHistory to use Avro for serialization instead of raw JSON
Date Fri, 18 Sep 2009 19:09:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757356#action_12757356
] 

Doug Cutting commented on MAPREDUCE-980:
----------------------------------------

> should we change the encoder to json [ ... ]

That was my initial instinct too, but Eric and Owen both indicated to me that they preferred
that we use binary.

Eric's comment is:

https://issues.apache.org/jira/browse/MAPREDUCE-157?focusedCommentId=12745279&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12745279

Owen has indicated this in offline discussions.  The idea is that one can easily use Avro
to dump the binary as JSON, but that the binary is smaller and faster.

It's a trivial change to make if we prefer JSON instead of binary.

> Modify JobHistory to use Avro for serialization instead of raw JSON
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-980
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-980
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Jothi Padmanabhan
>            Assignee: Doug Cutting
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-980.patch, MAPREDUCE-980.patch, MAPREDUCE-980.patch, MAPREDUCE-980.patch,
MAPREDUCE-980.patch, MAPREDUCE-980.patch, MAPREDUCE-980.patch, MAPREDUCE-980.patch, MAPREDUCE-980.patch,
MAPREDUCE-980.patch
>
>
> MAPREDUCE-157 modifies JobHistory to log events using Json Format.  This can be modified
to use Avro instead. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message