atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suma Shivaprasad (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-58) Make hive hook reliable
Date Wed, 09 Dec 2015 14:32:11 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suma Shivaprasad updated ATLAS-58:
----------------------------------
    Fix Version/s:     (was: trunk)
                   0.6-incubating

> Make hive hook reliable
> -----------------------
>
>                 Key: ATLAS-58
>                 URL: https://issues.apache.org/jira/browse/ATLAS-58
>             Project: Atlas
>          Issue Type: Sub-task
>            Reporter: Shwetha G S
>            Assignee: Shwetha G S
>              Labels: incompatible
>             Fix For: 0.6-incubating
>
>         Attachments: ATLAS-58-v2.patch, ATLAS-58-v5.patch, ATLAS-58.patch
>
>
> Currently, hive hook executes in background thread pool and is an best effort approach
to register entities. But this needs to be reliable for data governance to be effective
> One way is - in hive hook, add the entities to some messaging framework and atlas server
can read the entities from the message and register in atlas. Since, posting message is faster,
we can do it synchronously and hence reliable entity registration.
> We can start with kafka for messaging, but any other messaging framework should be pluggable



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message