atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-801) Atlas hooks would lose messages if Kafka is down for extended period of time
Date Tue, 14 Jun 2016 13:01:01 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329458#comment-15329458
] 

Hemanth Yamijala commented on ATLAS-801:
----------------------------------------

Filed ATLAS-901 to track this.

> Atlas hooks would lose messages if Kafka is down for extended period of time
> ----------------------------------------------------------------------------
>
>                 Key: ATLAS-801
>                 URL: https://issues.apache.org/jira/browse/ATLAS-801
>             Project: Atlas
>          Issue Type: Improvement
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>
> All integration hooks in Atlas write messages to Kafka which are picked up by the Atlas
server. If communication to Kafka breaks, then this results in loss of metadata messages.
This can be mitigated to some extent using multiple replicas for Kafka topics (see ATLAS-515).
This JIRA is to see if we can make this even more robust and have some form of store and forward
mechanism for increased fault tolerance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message