Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of ankur.goel@corp.aol.com
 designates 64.12.143.146 as permitted sender)
Date: Mon, 13 Apr 2009 16:57:26 +0530 (IST)
From: Ankur Goel <ankur.goel@corp.aol.com>
To: general@hadoop.apache.org
Message-ID: <19580353.281239622042153.JavaMail.ankur@localhost.localdomain>
In-Reply-To: <10963932.261239621910111.JavaMail.ankur@localhost.localdomain>
Subject: Re: [PROPOSAL] new subproject: Avro
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

How fast do we expect the new serialization system to be when it replaces existing serialization mechanism in Hadoop RPC?

A clear description of the existing bottlenecks and the performance goals for this system would help developers interested in contributing.

-Ankur


-------- Original Message --------
Subject: 	[PROPOSAL] new subproject: Avro
Date: 	Thu, 02 Apr 2009 15:05:08 -0700
From: 	Doug Cutting <cutting@apache.org>
Reply-To: 	general@hadoop.apache.org
To: 	general@hadoop.apache.org


I propose we add a new Hadoop subproject for Avro, a serialization 
system.  My ambition is for Avro to replace both Hadoop's RPC and to be 
used for most Hadoop data files, e.g., by Pig, Hive, etc.

Initial committers would be Sharad Agarwal and me, both existing Hadoop 
committers.  We are the sole authors of this software to date.

The code is currently at:

http://people.apache.org/~cutting/avro.git/

To learn more:

git clone http://people.apache.org/~cutting/avro.git/ avro
cat avro/README.txt

Comments?  Questions?

Doug