Mailing-List: contact user-help@storm.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@storm.apache.org
Received-SPF: pass (athena.apache.org: domain of arsneilson@gmail.com
 designates 209.85.215.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <37e6f241807de775d627fb2c921c1a4@cweb01.nmdf.nhnsystem.com>
References: 
 <CABcMBhA0ofuA5jv=CpKK3Y3n8uGQ3EbspWcx0PZipgY_yUFAVQ@mail.gmail.com>
	<CAE48+eVdC2vcVGfAeh3HubSj48wvj7KvNhov_10=eoq-7g0LiA@mail.gmail.com>
	<CABcMBhAYVtb1dVnumH8VAhfp=fL88sdvxhZ0XJbeVc=M1RwrNw@mail.gmail.com>
	<CAE48+eUFFwnWOnQ3ikJ80mAenru2vhb1ZmbxkV1ELFk9kHRjKg@mail.gmail.com>
	<54D0E98A.1080005@inovexcorp.com>
	<CAE48+eWhQk1Rhhj7oSupse8Jt4d8Hz21iib75kgpWWccM0J0ew@mail.gmail.com>
	<37e6f241807de775d627fb2c921c1a4@cweb01.nmdf.nhnsystem.com>
Date: Wed, 4 Feb 2015 12:49:04 -0800
Message-ID: 
 <CAHzwdyijF96YcVkiY0sRCA9etA4VQX9KdcKJbKBYvHNcGhb4BA@mail.gmail.com>
Subject: Re: Is there anyone who have experience of using storm with druid?
From: Andrew Neilson <arsneilson@gmail.com>
To: user@storm.apache.org,
 =?UTF-8?B?7J207Iq57KeE?= <sweetest.sj@navercorp.com>
Content-Type: multipart/alternative; boundary=047d7b3441c664d269050e495189

--047d7b3441c664d269050e495189
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I can't answer your question directly as I haven't used Druid, but I will
point out that Druid was developed by Metamarkets and they are using Druid
with Storm and Kafka in their architecture (
https://metamarkets.com/2014/building-a-data-pipeline-that-handles-billions=
-of-events-in-real-time/).
They've open-sourced Tranquility, which includes components for streaming
data from Storm to Druid:

https://github.com/metamx/tranquility

Hope this helps.

On Tue, Feb 3, 2015 at 7:17 PM, =EC=9D=B4=EC=8A=B9=EC=A7=84 <sweetest.sj@na=
vercorp.com> wrote:

> Hello all,
>
>
>
> We are about to implement aggregation feature in our system and for that
> we think it's a good option to use Druid with Storm.
>
>
>
> If any of you have experience, I want to here from you about these things=
.
>
>
>
> - data feeding : Do you feed data from kafka to druid directly or use
> Storm as a intermeidate refiner?
>
> - Did you develop custom druid driver for that?
>
> - any inconvenience during implementation?
>
>
>
> Thanks in advance
>

--047d7b3441c664d269050e495189
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I can&#39;t answer your question directly as I haven&#39;t=
 used Druid, but I will point out that Druid was developed by Metamarkets a=
nd they are using Druid with Storm and Kafka in their architecture (<a href=
=3D"https://metamarkets.com/2014/building-a-data-pipeline-that-handles-bill=
ions-of-events-in-real-time/">https://metamarkets.com/2014/building-a-data-=
pipeline-that-handles-billions-of-events-in-real-time/</a>). They&#39;ve op=
en-sourced Tranquility, which includes components for streaming data from S=
torm to Druid:<div><br></div><div><a href=3D"https://github.com/metamx/tran=
quility">https://github.com/metamx/tranquility</a><br></div><div><br></div>=
<div>Hope this helps.</div></div><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Tue, Feb 3, 2015 at 7:17 PM, =EC=9D=B4=EC=8A=B9=EC=A7=
=84 <span dir=3D"ltr">&lt;<a href=3D"mailto:sweetest.sj@navercorp.com" targ=
et=3D"_blank">sweetest.sj@navercorp.com</a>&gt;</span> wrote:<br><blockquot=
e class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc sol=
id;padding-left:1ex"><div style=3D"font-size:10pt;font-family:=EB=82=98=EB=
=88=94=EA=B3=A0=EB=94=95,NanumGothic,sans-serif"><p>Hello all,</p><p>=C2=A0=
</p><p><span style=3D"font-size:10pt;line-height:1.5">We are about to imple=
ment aggregation feature in our system and for that we think it&#39;s a goo=
d option to use Druid with Storm.</span>=C2=A0</p><p>=C2=A0</p><p>If any of=
 you have experience, I want to here from you about these things.</p><p>=C2=
=A0</p><p>- data feeding : Do you feed data from kafka to druid directly or=
 use Storm as a intermeidate refiner?</p><p>- Did you develop custom druid =
driver for that?</p><p>- any inconvenience during implementation?</p><p>=C2=
=A0</p><p>Thanks in advance</p></div>
<table><tbody><tr><td><img src=3D"http://ack.mail.navercorp.com/readReceipt=
/notify/?img=3Dr9nmFqKrFxJ0FqKYaqumF4MZFAu%2FKA%2BvpxbXF6trKo%2B4MoioaxUwMq=
JCFuIo%2BrkSKAu5W49vpSl51zlqDBFdp6d5MreRhoR9brkZtHFdWXiR74JmM6FcpLlTb4b%3D.=
gif" border=3D"0"></td></tr></tbody></table></blockquote></div><br></div>

--047d7b3441c664d269050e495189--