hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Van De vyver (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3787) Add serialization for Thrift
Date Wed, 04 Feb 2009 07:02:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12670263#action_12670263
] 

Mark Van De vyver commented on HADOOP-3787:
-------------------------------------------

I've seen several list discussions/mentions of Thrift and serialization, but have not seen
extprot yet mentioned.  It is recent, but relevant to this issue (and in its own right):

http://eigenclass.org/R2/writings/extprot-extensible-protocols-intro

and

http://eigenclass.org/R2/writings/protocol-extension-with-extprot

<quote>
At this point, you'll be thinking, "what, yet another Protocol Buffers/Thrift/ASN.1 DER/XDR/IIOP/IFF?"...
Not quite: extprot differentiates itself in that it allows for more extensions and supports
richer types (mainly tuples and disjoint union types aka. sum types) than Protocol Buffers
or Thrift without approaching the complexity of ASN.1 DER. (Note that XDR does not define
self-describing protocols, making protocol changes hard at best.)
</quote>

HTH?


> Add serialization for Thrift
> ----------------------------
>
>                 Key: HADOOP-3787
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3787
>             Project: Hadoop Core
>          Issue Type: Wish
>          Components: contrib/serialization, examples, mapred
>            Reporter: Tom White
>         Attachments: hadoop-3787.patch, libthrift.jar
>
>
> Thrift (http://incubator.apache.org/thrift/) is cross-language serialization and RPC
framework. This issue is to write a ThriftSerialization to support using Thrift types in MapReduce
programs, including an example program. This should probably go into contrib.
> (There is a prototype implementation in https://issues.apache.org/jira/secure/attachment/12370464/hadoop-serializer-v2.tar.gz)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message