hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jerome Boulon <jbou...@yahoo-inc.com>
Subject Re: [PROPOSAL] new subproject: Avro
Date Fri, 03 Apr 2009 20:59:54 GMT
Chukwa needs a cross language serialization/RPC framework.
During demux, being able to create dynamically the schema based on the recordType will be
a big plus instead of using an hardcoded one,
The projection feature will also be useful.



On 4/2/09 3:05 PM, "Doug Cutting" <cutting@apache.org> wrote:

I propose we add a new Hadoop subproject for Avro, a serialization
system.  My ambition is for Avro to replace both Hadoop's RPC and to be
used for most Hadoop data files, e.g., by Pig, Hive, etc.

Initial committers would be Sharad Agarwal and me, both existing Hadoop
committers.  We are the sole authors of this software to date.

The code is currently at:


To learn more:

git clone http://people.apache.org/~cutting/avro.git/ avro
cat avro/README.txt

Comments?  Questions?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message