hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pete Wyckoff (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3787) Add serialization for Thrift
Date Wed, 03 Sep 2008 17:21:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12628062#action_12628062
] 

Pete Wyckoff commented on HADOOP-3787:
--------------------------------------

bq. flat files with a suitable InputFormat (which would need to be written), 

See https://issues.apache.org/jira/browse/THRIFT-111. It provides a file format with fixed
sized blocks that can be compressed and written in python, perl, C++ and Java. This allows
a logging framework to write directly to a format that is splittable.  The records themselves
need not be thrift.





> Add serialization for Thrift
> ----------------------------
>
>                 Key: HADOOP-3787
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3787
>             Project: Hadoop Core
>          Issue Type: Wish
>          Components: examples, mapred
>            Reporter: Tom White
>         Attachments: hadoop-3787.patch, libthrift.jar
>
>
> Thrift (http://incubator.apache.org/thrift/) is cross-language serialization and RPC
framework. This issue is to write a ThriftSerialization to support using Thrift types in MapReduce
programs, including an example program. This should probably go into contrib.
> (There is a prototype implementation in https://issues.apache.org/jira/secure/attachment/12370464/hadoop-serializer-v2.tar.gz)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message