avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anand Padmanaban <apadmana...@splunk.com>
Subject RE: writing to socket in python
Date Thu, 27 Jan 2011 14:27:33 GMT
That wouldn't work for me.  The avroSource that flume will be listening on does not take http.

Thanks,
Anand.

> -----Original Message-----
> From: R. Tyler Croy [mailto:tyler@monkeypox.org]
> Sent: Wednesday, January 26, 2011 7:43 PM
> To: user@avro.apache.org
> Subject: Re: writing to socket in python
> 
> 
> On Wed, 26 Jan 2011, Anand Padmanaban wrote:
> 
> > Writing avro to a file is easy in python, just use avro.datafile.DataFileWriter.
 Is there an equivalent to write over the wire?
> Specifically flume will be listening on the other end.
> 
> IIRC DataFileWriter won't work over a socket because it needs .seek().
> 
> You should look into Avro RPC support with Python, which uses HTTP as a
> transport, for writing messages over a wire.
> 
> I've got some code on doing so with eventlet here:
>     <http://unethicalblogger.com/posts/2010/05/howto_using_avro_eventlet>
> 
> 
> - R. Tyler Croy
> --------------------------------------
>     Code: http://github.com/rtyler
>  Chatter: http://twitter.com/agentdero
>           http://identi.ca/dero

Mime
View raw message