hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21631) Enhance metastore API to allow bulk-loading materialized views
Date Thu, 25 Apr 2019 19:49:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jesus Camacho Rodriguez updated HIVE-21631:
-------------------------------------------
       Resolution: Fixed
    Fix Version/s: 4.0.0
           Status: Resolved  (was: Patch Available)

Pushed to master, thanks for reviewing [~thejas]

> Enhance metastore API to allow bulk-loading materialized views
> --------------------------------------------------------------
>
>                 Key: HIVE-21631
>                 URL: https://issues.apache.org/jira/browse/HIVE-21631
>             Project: Hive
>          Issue Type: Bug
>          Components: Materialized views, Metastore
>    Affects Versions: 3.2.0, 3.1.1
>            Reporter: Craig Condit
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>         Attachments: HIVE-21631.patch, HIVE-21631.patch, HIVE-21631.patch, HIVE-21631.patch
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Currently, every query in HS2 results in a metastore call per database to retrieve all
materialized views. This causes severe performance degradation on multi-tenant clusters with
thousands of databases (very similar to how the old get_function() metastore call didn't scale).
> We should add a metastore call which can retrieve all materialized view definitions at
once (for all DBs) so that we don't have to make thousands of metastore calls per query.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message