flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Avro source and sink
Date Thu, 04 Sep 2014 08:44:44 GMT
Avro records shall have the schema embedded with them. Have a look at
source, that shall help a bit


On Wed, Sep 3, 2014 at 10:30 PM, Ed Judge <ejudgie@gmail.com> wrote:

> That’s helpful but isn’t there some type of Avro schema negotiation that
> occurs?
>
> -Ed
>
> On Sep 3, 2014, at 12:02 AM, Jeff Lord <jlord@cloudera.com> wrote:
>
> Ed,
>
> Did you take a look at the javadoc in the source?
> Basically the source uses netty as a server and the sink is just an rpc
> client.
> If you read over the doc which is in the two links below and take a look
> at the developer guide and still have questions just ask away and someone
> will help to answer.
>
>
> https://github.com/apache/flume/blob/trunk/flume-ng-core/src/main/java/org/apache/flume/source/AvroSource.java
>
>
> https://github.com/apache/flume/blob/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AvroSink.java
>
> https://flume.apache.org/FlumeDeveloperGuide.html#transaction-interface
>
> -Jeff
>
>
>
>
>
>
> On Tue, Sep 2, 2014 at 6:36 PM, Ed Judge <ejudgie@gmail.com> wrote:
>
>> Does anyone know of any good documentation that talks about the
>> protocol/negotiation used between an Avro source and sink?
>>
>> Thanks,
>> Ed
>>
>>
>
>


-- 
thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

Mime
View raw message