atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-515) Ability to initialize Kafka topics with more than 1 replica
Date Fri, 03 Jun 2016 10:44:59 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hemanth Yamijala updated ATLAS-515:
-----------------------------------
    Attachment: ATLAS-515-poc.patch

This patch is attached as proof of concept (not for review / commit). I am using the class
called AdminUtils which appears to be the existing interface to do operations like add topics
etc.

I tested this with HiveServer2 and the topic was setup fine with 2 replicas as provided in
the code.

> Ability to initialize Kafka topics with more than 1 replica
> -----------------------------------------------------------
>
>                 Key: ATLAS-515
>                 URL: https://issues.apache.org/jira/browse/ATLAS-515
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>             Fix For: 0.7-incubating
>
>         Attachments: ATLAS-515-poc.patch
>
>
> Atlas uses two Kafka topics - ATLAS_HOOK and ATLAS_ENTITIES for communicating with its
upstream and downstream dependencies. If not explicitly created, these topics are setup with
a single replica. From a HA perspective, this becomes a problem. This JIRA is to request for
a mechanism for creating topics with more than 1 replica. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message