hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milind Bhandarkar (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-65) add a record I/O framework to hadoop
Date Wed, 03 May 2006 22:23:20 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-65?page=all ]

Milind Bhandarkar updated HADOOP-65:
------------------------------------

    Attachment: HadoopRecordIO.patch

I have attached a patch for Hadoop record I/O framework. It contains a translator for generating
Java or C++ code from the record definitions, and a Java and C++ runtime library for serializing
and deserializing records in binary, CSV, and XML formats. Generated Java code for records
implements the WritableComparable interface, so these records could be used as keys and values
for the Hadooop map-reduce framework. See the package.html file in org.apache.hadoop.record
for full description.

> add a record I/O framework to hadoop
> ------------------------------------
>
>          Key: HADOOP-65
>          URL: http://issues.apache.org/jira/browse/HADOOP-65
>      Project: Hadoop
>         Type: New Feature

>   Components: io, ipc
>     Versions: 0.2
>     Reporter: Sameer Paranjpye
>     Priority: Minor
>      Fix For: 0.2
>  Attachments: HadoopRecordIO.patch
>
> Hadoop could benefit greatly from a simple record I/O framework that enables the specification
of simple record types and enables the generation of code for serialization/deserialization
in multiple target languages. The framework would handle a small well understood set of primitive
types and simple compositions of these (structs, vectors, maps) . It would be possible to
leverage this framework to express I/O in MapReduce computations and to use this as the basis
for Hadoops RPC implementation. This would make interfacing with code in languages other than
Java much easier.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


Mime
View raw message