Return-Path: Delivered-To: apmail-avro-user-archive@www.apache.org Received: (qmail 33086 invoked from network); 28 Jan 2011 21:02:28 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 28 Jan 2011 21:02:28 -0000 Received: (qmail 51957 invoked by uid 500); 28 Jan 2011 21:02:28 -0000 Delivered-To: apmail-avro-user-archive@avro.apache.org Received: (qmail 51887 invoked by uid 500); 28 Jan 2011 21:02:27 -0000 Mailing-List: contact user-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@avro.apache.org Delivered-To: mailing list user@avro.apache.org Received: (qmail 51879 invoked by uid 99); 28 Jan 2011 21:02:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Jan 2011 21:02:27 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [64.78.22.16] (HELO EXHUB017-1.exch017.msoutlookonline.net) (64.78.22.16) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Jan 2011 21:02:22 +0000 Received: from EXVMBX017-1.exch017.msoutlookonline.net ([64.78.22.47]) by EXHUB017-1.exch017.msoutlookonline.net ([64.78.22.16]) with mapi; Fri, 28 Jan 2011 13:02:01 -0800 From: Anand Padmanaban To: "user@avro.apache.org" Date: Fri, 28 Jan 2011 13:02:05 -0800 Subject: RE: How to get started with examples on avro Thread-Topic: How to get started with examples on avro Thread-Index: Acu/KiOMpnk2vVAnTL+9LrjUdHA/6wAA0Ifw Message-ID: <79A1E64A36D5D64A86E9A06BC828068001994D1A82@EXVMBX017-1.exch017.msoutlookonline.net> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Meta question. I see avro is the means, what is the end goal? What do you= want to do with the data after converting it to avro? > -----Original Message----- > From: felix gao [mailto:gre1600@gmail.com] > Sent: Friday, January 28, 2011 12:30 PM > To: user@avro.apache.org > Subject: Re: How to get started with examples on avro >=20 > Thanks for the quick reply. I am interested in doing this through the ja= va implementation and I would like to do it in parallel that > utilizes the mapreduce framework. >=20 >=20 > On Fri, Jan 28, 2011 at 12:22 PM, Harsh J wrote: >=20 >=20 > Based on the language you're targeting, have a look at its test-cases > available on the in the project's version control: > http://svn.apache.org/repos/asf/avro/trunk/lang/ [You can check it out > via SVN, or via Git mirrors] >=20 > Another good resource on the ends of Avro (Data and RPC) is by phunt > at http://github.com/phunt/avro-rpc-quickstart#readme >=20 > I had written a python data-file centric snippet for Avro a while ago > at my blog; it may help if you're looking to get started with Python > (although it does not cover all aspects, which the functions in the > available test cases for lang/python do): > http://www.harshj.com/2010/04/25/writing-and-reading-avro-data-files-usi= ng-python/ >=20 >=20 > On Sat, Jan 29, 2011 at 1:34 AM, felix gao wrote: > > Hi all, > > I am trying to convert a lot of our existing logs into avro format in > > hadoop. I am not sure if there are any examples to follow. > > Thanks, > > Felix >=20 >=20 >=20 >=20 > -- > Harsh J > www.harshj.com >=20 >=20