activemq-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (ARTEMIS-1478) ActiveMQ Artemis to Kafka Bridge
Date Wed, 25 Oct 2017 14:22:00 GMT


ASF GitHub Bot commented on ARTEMIS-1478:

Github user michaelandrepearce commented on a diff in the pull request:
    --- Diff: docs/user-manual/en/ ---
    @@ -0,0 +1,180 @@
    +# Apache ActiveMQ Kafka Bridge
    +The function of a bridge is to consume messages from a source queue in Apache ActiveMQ
    +and forward them to a target topic, on a remote Apache Kafka server.
    +By pairing Apache ActiveMQ Artemis and Apache Kafka with the bridge you could have a
hybrid broker setup, 
    +having a data flow with CORE, AMQP, MQTT clients, as well as now Kafka clients also.

    +Taking and giving the best features of both broker technologies when and where needed
for a flow of data.
    +![ActiveMQ Artemis Kafka Bridge Clients](images/activemq-kafka-bridge-clients.png)
    +The intent is this will be a two way bridge, but currently the flow is a single direction

    +from Apache ActiveMQ Artemis to Apache Kafka
    +The source and target servers are remote making bridging suitable
    +for reliably sending messages from one artemis cluster to kafka, 
    +for instance across a WAN, to the cloud, or internet and where the connection may be
    +The bridge has built in resilience to failure so if the target server
    +connection is lost, e.g. due to network failure, the bridge will retry
    +connecting to the target until it comes back online. When it comes back
    +online it will resume operation as normal.
    +![ActiveMQ Artemis Kafka Bridge Diagram](images/activemq-kafka-bridge-diagram.png)
    --- End diff --
    have updated image.

> ActiveMQ Artemis to Kafka Bridge
> --------------------------------
>                 Key: ARTEMIS-1478
>                 URL:
>             Project: ActiveMQ Artemis
>          Issue Type: Bug
>            Reporter: Michael Andre Pearce
>            Assignee: Michael Andre Pearce
> To create a service connector to bridge messages in similar fashion as a core bridge
to kafka. 
> The first scope of this is to provide an Artemis to Kafka bridge, but the end goal (another
jira later) to provide the return leg.
> This essentially would mean for a data flow clients can connect and produce to a data
flow on all the supported protocols (amqp, core, mqtt etc) and like wise consume, but also
on the same data flow you can have kafka consumers. 

This message was sent by Atlassian JIRA

View raw message