hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12856) LLAP: update (add/remove) the UDFs available in LLAP when they are changed (refresh periodically)
Date Fri, 19 Feb 2016 00:49:18 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153452#comment-15153452
] 

Sergey Shelukhin commented on HIVE-12856:
-----------------------------------------

That defeats the purpose of not allowing UDFs in LLAP, if I understand it correctly - if every
fragment can tell you what's in the whitelist then why have the whitelist at all.

> LLAP: update (add/remove) the UDFs available in LLAP when they are changed (refresh periodically)
> -------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-12856
>                 URL: https://issues.apache.org/jira/browse/HIVE-12856
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12856.01.nogen.patch, HIVE-12856.01.patch, HIVE-12856.02.nogen.patch,
HIVE-12856.02.patch, HIVE-12856.nogen.patch, HIVE-12856.patch
>
>
> I don't think re-querying the functions is going to scale, and the sessions obviously
cannot notify all LLAP clusters of every change. We should add global versioning to metastore
functions to track changes, and then possibly add a notification mechanism, potentially thru
ZK to avoid overloading the metastore itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message