hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <>
Subject [jira] [Updated] (HIVE-21631) Enhance metastore API to allow bulk-loading materialized views
Date Thu, 25 Apr 2019 19:49:00 GMT


Jesus Camacho Rodriguez updated HIVE-21631:
       Resolution: Fixed
    Fix Version/s: 4.0.0
           Status: Resolved  (was: Patch Available)

Pushed to master, thanks for reviewing [~thejas]

> Enhance metastore API to allow bulk-loading materialized views
> --------------------------------------------------------------
>                 Key: HIVE-21631
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Materialized views, Metastore
>    Affects Versions: 3.2.0, 3.1.1
>            Reporter: Craig Condit
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>         Attachments: HIVE-21631.patch, HIVE-21631.patch, HIVE-21631.patch, HIVE-21631.patch
>          Time Spent: 20m
>  Remaining Estimate: 0h
> Currently, every query in HS2 results in a metastore call per database to retrieve all
materialized views. This causes severe performance degradation on multi-tenant clusters with
thousands of databases (very similar to how the old get_function() metastore call didn't scale).
> We should add a metastore call which can retrieve all materialized view definitions at
once (for all DBs) so that we don't have to make thousands of metastore calls per query.

This message was sent by Atlassian JIRA

View raw message