hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Work started] (HIVE-21631) Enhance metastore API to allow bulk-loading materialized views
Date Tue, 23 Apr 2019 01:53:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Work on HIVE-21631 started by Jesus Camacho Rodriguez.
------------------------------------------------------
> Enhance metastore API to allow bulk-loading materialized views
> --------------------------------------------------------------
>
>                 Key: HIVE-21631
>                 URL: https://issues.apache.org/jira/browse/HIVE-21631
>             Project: Hive
>          Issue Type: Bug
>          Components: Materialized views, Metastore
>    Affects Versions: 3.2.0, 3.1.1
>            Reporter: Craig Condit
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>
> Currently, every query in HS2 results in a metastore call per database to retrieve all
materialized views. This causes severe performance degradation on multi-tenant clusters with
thousands of databases (very similar to how the old get_function() metastore call didn't scale).
> We should add a metastore call which can retrieve all materialized view definitions at
once (for all DBs) so that we don't have to make thousands of metastore calls per query.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message