Mailing-List: contact dev-help@activemq.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@activemq.apache.org
MIME-Version: 1.0
In-Reply-To: <CACHnxzz1_JfLgE0J1QQ2RB_DcPFNzH4roJ_a-8tssSfq82rYwA@mail.gmail.com>
References: <D666AB6F-3337-40FA-B1A6-F567281FC972@me.com> <CAA9ykMJng9xiRXWVwmtx-jBCqHboE8+0zhQ76EN+simjjAkN5w@mail.gmail.com>
 <8D68B0BD-7EC9-4F96-AFE2-9EAC9DA5949C@me.com> <CACHnxzz1_JfLgE0J1QQ2RB_DcPFNzH4roJ_a-8tssSfq82rYwA@mail.gmail.com>
From: Andy Taylor <andy.tayls67@gmail.com>
Date: Fri, 6 Oct 2017 12:14:47 +0100
Message-ID: <CAA9ykM+TrLNTJPyy8YENtv8w2zAW-fVP4b8UMTBmNkBXRsu0Zw@mail.gmail.com>
Subject: Re: Kafka ServiceConnector
To: dev@activemq.apache.org
Content-Type: multipart/alternative; boundary="001a1142b41cf1b149055adef28e"
archived-at: Fri, 06 Oct 2017 11:14:55 -0000

--001a1142b41cf1b149055adef28e
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I think https://github.com/ppatierno/kafka-connect-amqp is an example of
this

On 6 October 2017 at 12:07, Christopher Shannon <
christopher.l.shannon@gmail.com> wrote:

> Why not use Kafka's Connect framework?  Seems like building a source
> connector here would make the most sense.  This is not to say I'm against
> the idea I'm just wondering the benefits of doing it from the Artemis sid=
e
> of things when Kafka already has a framework that can be used to
> import/export data.
>
> On Fri, Oct 6, 2017 at 6:16 AM, Michael Andr=C3=A9 Pearce <
> michael.andre.pearce@me.com> wrote:
>
> > Hi Andy,
> >
> > As you may be aware or not we run both activemq and kafka each has a
> > specific plus point to it, use the right tool for the right job.
> >
> > We use activemq as our feature rich, fully jms compliant and performant
> > broker.
> >
> > And use kafka more for post processing and data streaming, with
> historical
> > feed also.
> >
> > Idea here is that producers and consumers bind into our activemq where
> jms
> > api is wanted or needed, lower per message latencies etc. but then we c=
an
> > bridge messages from a core queue into kafka so that the data can flow =
to
> > it as fast as possible and consumed from there also.
> >
> > Idea is to try make a hybrid taking best of both.
> >
> > Cheers
> > Mike
> >
> > Sent from my iPhone
> >
> > > On 6 Oct 2017, at 09:37, Andy Taylor <andy.tayls67@gmail.com> wrote:
> > >
> > > Whats the use case here Michael, sounds like a cool idea and somethin=
g
> > that
> > > has been mentioned by different people but I am yet to understand how
> > this
> > > could be used.
> > >
> > > On 6 October 2017 at 07:48, Michael Andr=C3=A9 Pearce <
> > > michael.andre.pearce@me.com> wrote:
> > >
> > >> Hi All,
> > >>
> > >> I am looking to contribute an artemis ServiceConnector that would
> > leverage
> > >> the existing service connector interface to bridge from a queue into=
 a
> > >> kafka topic similar to bridge between artemis clusters.
> > >>
> > >> Idea is to make it configurable how to transform and encode the
> message
> > in
> > >> kafka but as amqp is becoming very well supported by artemis provide
> out
> > >> the box that the message be encoded in amqp byte protocol.
> > >>
> > >> It something I=E2=80=99ve been working on privately for a bit, but s=
ince
> > becoming
> > >> a committer here is really like to share it.
> > >>
> > >> I hope if I get a positive response here to get a branch ready soon,
> but
> > >> feedback if this is welcomed would be great.
> > >>
> > >> Cheers
> > >> Mike
> > >>
> > >>
> > >> Sent from my iPhone
> >
>

--001a1142b41cf1b149055adef28e--