Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
Received-SPF: pass (nike.apache.org: domain of otis.gospodnetic@gmail.com
 designates 209.85.192.54 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAH6sOuhOjb1+5KBeQd9gpxRnLWB-oOgZuHuKn+zMYV7_v=0ASg@mail.gmail.com>
References: 
 <CAH6sOuhOjb1+5KBeQd9gpxRnLWB-oOgZuHuKn+zMYV7_v=0ASg@mail.gmail.com>
Date: Tue, 28 Oct 2014 12:02:02 -0400
Message-ID: 
 <CANNBgPLTynF=XFB+Gmk7uCs3feF+6-N-tTeEmjN+-NBNtjdSQg@mail.gmail.com>
Subject: Re: Dynamic sink configuration
From: Otis Gospodnetic <otis.gospodnetic@gmail.com>
To: user@flume.apache.org
Content-Type: multipart/alternative; boundary=001a11c3ec7a924cfd05067dc491

--001a11c3ec7a924cfd05067dc491
Content-Type: text/plain; charset=UTF-8

As far as I know, Flume is configured only through the config and I *think*
Flume automatically reloads the config when it detects the config changed -
at least that is what Ashish wrote here:
http://search-hadoop.com/m/DEeB4w0kHg1

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/


On Mon, Oct 27, 2014 at 7:42 PM, Pavel Zalunin <wr4bbit@gmail.com> wrote:

> Hi,
>
> We have embedded flume agent and we need to update some parameters
> dynamically after sink/source runners are started.
>
> For example, having sink which sends events to some url. At some point we
> need to change this url (add request parameter for example).
>
> Straightforward way is to add method which will accept changes and update
> internal state, but it looks like a 'hack', because all flume sinks, that
> I've seen configured just once.
>
> Maybe there are another, 'flume-way' to do such things?
>
> Is restarting sink (I think restart other related things also needed) only
> one option?
>
> Thanks,
> Pavel.
>

--001a11c3ec7a924cfd05067dc491
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">As far as I know, Flume is configured only through the con=
fig and I *think* Flume automatically reloads the config when it detects th=
e config changed - at least that is what Ashish wrote here:=C2=A0<a href=3D=
"http://search-hadoop.com/m/DEeB4w0kHg1">http://search-hadoop.com/m/DEeB4w0=
kHg1</a><div class=3D"gmail_extra"><br></div><div class=3D"gmail_extra"><di=
v><div dir=3D"ltr">Otis<br>--<br><div><div style=3D"font-family:arial;font-=
size:small">Monitoring * Alerting * Anomaly Detection * Centralized Log Man=
agement</div><div style=3D"font-family:arial;font-size:small">Solr &amp; El=
asticsearch Support *=C2=A0<a href=3D"http://sematext.com/" style=3D"color:=
rgb(17,85,204)" target=3D"_blank">http://sematext.com/</a><br></div></div><=
div><br></div></div></div>
<br><div class=3D"gmail_quote">On Mon, Oct 27, 2014 at 7:42 PM, Pavel Zalun=
in <span dir=3D"ltr">&lt;<a href=3D"mailto:wr4bbit@gmail.com" target=3D"_bl=
ank">wr4bbit@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_=
quote" style=3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-=
color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir=
=3D"ltr">Hi,<div><br></div><div>We have embedded flume agent and we need to=
 update some parameters dynamically after sink/source runners are started.=
=C2=A0</div><div><br></div><div>For example, having sink which sends events=
 to some url. At some point we need to change this url (add request paramet=
er for example).=C2=A0</div><div><br></div><div>Straightforward way is to a=
dd method which will accept changes and update internal state, but it looks=
 like a &#39;hack&#39;, because all flume sinks, that I&#39;ve seen configu=
red just once.</div><div><br></div><div>Maybe there are another, &#39;flume=
-way&#39; to do such things?</div><div><br></div><div>Is restarting sink (I=
 think restart other related things also needed) only one option?=C2=A0</di=
v><div><br></div><div>Thanks,</div><div>Pavel.</div></div>
</blockquote></div><br></div></div>

--001a11c3ec7a924cfd05067dc491--