activemq-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ARTEMIS-1478) ActiveMQ Artemis to Kafka Bridge
Date Wed, 25 Oct 2017 14:22:00 GMT

    [ https://issues.apache.org/jira/browse/ARTEMIS-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16218718#comment-16218718
] 

ASF GitHub Bot commented on ARTEMIS-1478:
-----------------------------------------

Github user michaelandrepearce commented on a diff in the pull request:

    https://github.com/apache/activemq-artemis/pull/1607#discussion_r146872793
  
    --- Diff: docs/user-manual/en/kafka-bridges.md ---
    @@ -0,0 +1,180 @@
    +# Apache ActiveMQ Kafka Bridge
    +
    +The function of a bridge is to consume messages from a source queue in Apache ActiveMQ
Artemis, 
    +and forward them to a target topic, on a remote Apache Kafka server.
    +
    +By pairing Apache ActiveMQ Artemis and Apache Kafka with the bridge you could have a
hybrid broker setup, 
    +having a data flow with CORE, AMQP, MQTT clients, as well as now Kafka clients also.

    +Taking and giving the best features of both broker technologies when and where needed
for a flow of data.
    +
    +![ActiveMQ Artemis Kafka Bridge Clients](images/activemq-kafka-bridge-clients.png)
    +
    +The intent is this will be a two way bridge, but currently the flow is a single direction

    +from Apache ActiveMQ Artemis to Apache Kafka
    +
    +
    +The source and target servers are remote making bridging suitable
    +for reliably sending messages from one artemis cluster to kafka, 
    +for instance across a WAN, to the cloud, or internet and where the connection may be
unreliable.
    +
    +The bridge has built in resilience to failure so if the target server
    +connection is lost, e.g. due to network failure, the bridge will retry
    +connecting to the target until it comes back online. When it comes back
    +online it will resume operation as normal.
    +
    +![ActiveMQ Artemis Kafka Bridge Diagram](images/activemq-kafka-bridge-diagram.png)
    --- End diff --
    
    have updated image.


> ActiveMQ Artemis to Kafka Bridge
> --------------------------------
>
>                 Key: ARTEMIS-1478
>                 URL: https://issues.apache.org/jira/browse/ARTEMIS-1478
>             Project: ActiveMQ Artemis
>          Issue Type: Bug
>            Reporter: Michael Andre Pearce
>            Assignee: Michael Andre Pearce
>
> To create a service connector to bridge messages in similar fashion as a core bridge
to kafka. 
> The first scope of this is to provide an Artemis to Kafka bridge, but the end goal (another
jira later) to provide the return leg.
> This essentially would mean for a data flow clients can connect and produce to a data
flow on all the supported protocols (amqp, core, mqtt etc) and like wise consume, but also
on the same data flow you can have kafka consumers. 
> http://activemq.2283324.n4.nabble.com/Kafka-ServiceConnector-td4731430.html#a4731436



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message