hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18387) Minimize time that REBUILD locks the materialized view
Date Wed, 21 Feb 2018 09:45:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371155#comment-16371155
] 

Zoltan Haindrich commented on HIVE-18387:
-----------------------------------------

[~jcamachorodriguez] it seems to me that [druidmini_mv test|https://builds.apache.org/job/PreCommit-HIVE-Build/9287/testReport/org.apache.hadoop.hive.cli/TestMiniDruidCliDriver/testCliDriver_druidmini_mv_/]
is failing since this commit; there are some resultset differences as well; could you please
take a look?

> Minimize time that REBUILD locks the materialized view
> ------------------------------------------------------
>
>                 Key: HIVE-18387
>                 URL: https://issues.apache.org/jira/browse/HIVE-18387
>             Project: Hive
>          Issue Type: Improvement
>          Components: Materialized views
>    Affects Versions: 3.0.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>             Fix For: 3.0.0
>
>         Attachments: HIVE-18387.01.patch, HIVE-18387.02.patch, HIVE-18387.03.patch, HIVE-18387.04.patch,
HIVE-18387.05.patch, HIVE-18387.07.patch, HIVE-18387.08.patch, HIVE-18387.09.patch, HIVE-18387.11.patch,
HIVE-18387.patch
>
>
> Currently, REBUILD will block the materialized view while the final move task is being
executed. The idea for this improvement is to create the new materialization in a new folder
(new version) and then just flip the pointer to the folder in the MV definition in the metastore.
REBUILD operations for a given MV should get an exclusive lock though, i.e., they cannot be
executed concurrently.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message