Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 98540 invoked from network); 3 Apr 2009 21:00:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Apr 2009 21:00:43 -0000 Received: (qmail 69106 invoked by uid 500); 3 Apr 2009 21:00:42 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 69035 invoked by uid 500); 3 Apr 2009 21:00:42 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 69025 invoked by uid 99); 3 Apr 2009 21:00:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 21:00:42 +0000 X-ASF-Spam-Status: No, hits=4.2 required=10.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.145.54.172] (HELO mrout2.yahoo.com) (216.145.54.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 21:00:31 +0000 Received: from sp1-ex07cas01.ds.corp.yahoo.com (sp1-ex07cas01.ds.corp.yahoo.com [216.252.116.137]) by mrout2.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id n33KxuxA053324 for ; Fri, 3 Apr 2009 13:59:56 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=received:from:to:date:subject:thread-topic:thread-index: message-id:in-reply-to:accept-language:content-language: x-ms-has-attach:x-ms-tnef-correlator:acceptlanguage:content-type:mime-version; b=anVY80lL0Ls8JrEZgIAZVFs10cs0XrA9R9B0n+42zIMISXd45nkLPo9cGN59nTh0 Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.135]) by sp1-ex07cas01.ds.corp.yahoo.com ([216.252.116.137]) with mapi; Fri, 3 Apr 2009 13:59:56 -0700 From: Jerome Boulon To: "general@hadoop.apache.org" Date: Fri, 3 Apr 2009 13:59:54 -0700 Subject: Re: [PROPOSAL] new subproject: Avro Thread-Topic: [PROPOSAL] new subproject: Avro Thread-Index: Acmz32qJXRwwUeKUTougg4PRElvdIAAv7irY Message-ID: In-Reply-To: <49D53694.1050906@apache.org> Accept-Language: en-US Content-Language: en X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_C5FBC6DA198B7jboulonyahooinccom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_C5FBC6DA198B7jboulonyahooinccom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Chukwa needs a cross language serialization/RPC framework. During demux, being able to create dynamically the schema based on the reco= rdType will be a big plus instead of using an hardcoded one, The projection feature will also be useful. +1 /Jerome. On 4/2/09 3:05 PM, "Doug Cutting" wrote: I propose we add a new Hadoop subproject for Avro, a serialization system. My ambition is for Avro to replace both Hadoop's RPC and to be used for most Hadoop data files, e.g., by Pig, Hive, etc. Initial committers would be Sharad Agarwal and me, both existing Hadoop committers. We are the sole authors of this software to date. The code is currently at: http://people.apache.org/~cutting/avro.git/ To learn more: git clone http://people.apache.org/~cutting/avro.git/ avro cat avro/README.txt Comments? Questions? Doug --_000_C5FBC6DA198B7jboulonyahooinccom_--