flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Lord <jl...@cloudera.com>
Subject Re: Binding Avro Sink to local private ip
Date Thu, 19 Mar 2015 20:54:58 GMT
Well technically the process does not "bind" to an interface but rather a
port.
>From there the routes defined on your machine/net will determine which
interface is used. The sink doesn't bind to a port at all though it simply
leverages the host provided network stack and routing rules as you have
discovered. Glad to hear you were able to get it working!

On Thu, Mar 19, 2015 at 12:33 PM, Majid Alfifi <majid.alfifi@gmail.com>
wrote:

> Hi Jeff,
>
> The avro source is running on a different server. The server running the
> avro sink has two network interfaces one public and another for a private
> network. When I checked network utilization I found that the avro sink is
> using the public ip. I was hoping there might be a way to specify which
> interface the avro sink should use.
>
> After some checking I found out I was actually using the public interface
> of the remote avro source so there was no way to reach it using the private
> interface. When I changed that, the avro sink automatically started using
> the private interface. I am not sure if there is any case where the ability
> to bind to a certain local interface maybe useful or even meaningful.
>
> Thanks,
> Majid
>
> agent.sinks.AvroSink.type = avro
> agent.sinks.AvroSink.channel = MemChannel
> agent.sinks.AvroSink.hostname = 189.45.**.**
> agent.sinks.AvroSink.port = 4353
> agent.sinks.AvroSink.compression-type = deflate
> agent.sinks.AvroSink.batch-size=400
>
> agent.sources.AvroSource.type = avro
> agent.sources.AvroSource.channels = FileChannel
> agent.sources.AvroSource.bind = 0.0.0.0
> agent.sources.AvroSource.port = 4353
> agent.sources.AvroSource.compression-type = deflate
>
>
> On Thu, Mar 19, 2015 at 10:07 PM, Jeff Lord <jlord@cloudera.com> wrote:
>
>> Hi Majid,
>>
>> What are you trying to accomplish? It should be fine to point to the
>> localhost or the local ip if in fact you are running an avro source there
>> as well.
>> Can you please share your config?
>>
>> -Jeff
>>
>>
>> On Thu, Mar 19, 2015 at 12:01 PM, Majid Alfifi <majid.alfifi@gmail.com>
>> wrote:
>>
>>> I am trying to make an Avro Sink uses a private IP but couldn't figure
>>> out a way to do it. There is "host" configuration to point to the
>>> destination Avro Source but nothing for the local interface.
>>>
>>> That will be helpful in utilizing the private network.
>>>
>>> Anyone aware of a way to achieve this?
>>>
>>> Thanks,
>>> Majid
>>>
>>>
>>>
>>
>

Mime
View raw message