accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Geoffry Roberts <threadedb...@gmail.com>
Subject Re: Kafka to Accumulo
Date Wed, 10 Dec 2014 18:20:20 GMT
FWIW

I am not a Storm expert but I am evaluating it for my current work.  The
idea of writing a Storm bolt that writes out Accumulo Mutations seems a
good approach.

I agree with Ryan.

On Wed, Dec 10, 2014 at 10:31 AM, Webb, Ryan L. <Ryan.Webb@jhuapl.edu>
wrote:

>  Storm is slowly making its Kafka spout a first class citizen.
>
> It wouldn’t be too hard to have a simple topology that uses the
> storm-kafka spout and a custom bolt that rights out to Accumulo.
>
>
>
> Ryan Webb
>
>
>
> *From:* Ariel Valentin [mailto:ariel@arielvalentin.com]
> *Sent:* Wednesday, December 10, 2014 8:06 AM
> *To:* user@accumulo.apache.org
> *Subject:* Re: Kafka to Accumulo
>
>
>
> I have mostly seen storm in the wild but that doesn't mean it's the right
> one. I think the answer depends on your context. Do you have
> flume/morphline experts? Do you run storm topologies now? I have never used
> spark and there isn't any official integration support AFAIK.
>
>
> Thanks,
>
> Ariel
>
> ---
>
> Sent from my mobile device. Please excuse any errors.
>
>
> On Dec 10, 2014, at 7:21 AM, kishore kumar <akishore769@gmail.com> wrote:
>
>  flume/spark/storm ?
>
>
>
> On Wed, Dec 10, 2014 at 5:29 PM, Ariel Valentin <ariel@arielvalentin.com>
> wrote:
>
> I am not aware of any tools that do this right now. Most of the apps I
> have seen use custom programs that pull the messages off the queue, parse
> them, then write mutations to the tables. Does that seem reasonable? Is
> there another data store that has the kind of Kafka integration you are
> hoping for in accumulo?
>
>
> Thanks,
>
> Ariel
>
> ---
>
> Sent from my mobile device. Please excuse any errors.
>
>
> On Dec 10, 2014, at 6:51 AM, kishore kumar <akishore769@gmail.com> wrote:
>
>  yes ariel.
>
>
>
> On Wed, Dec 10, 2014 at 5:06 PM, Ariel Valentin <ariel@arielvalentin.com>
> wrote:
>
> Kishore,
>
> I am afraid I don't understand your question. Are you trying to consume
> data from a queue and write it into a table?
>
> Thanks,
> Ariel
> ---
> Sent from my mobile device. Please excuse any errors.
>
>
> > On Dec 10, 2014, at 3:18 AM, kishore kumar <akishore769@gmail.com>
> wrote:
> >
> > Hi Experts,
> >
> > Is there any link to integrate the data from kafka to accumulo, if yes
> please share with me.
> >
> > --
> > Thanks,
> > Kishore.
>
>
>
>
>
> --
>
> Thanks,
>
> Kishore.
>
>
>
>
>
> --
>
> Thanks,
>
> Kishore.
>
>


-- 
There are ways and there are ways,

Geoffry Roberts

Mime
View raw message