hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-7389) Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
Date Mon, 29 Sep 2014 19:55:33 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gunther Hagleitner updated HIVE-7389:
-------------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

committed to trunk and hive-14

> Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-7389
>                 URL: https://issues.apache.org/jira/browse/HIVE-7389
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Critical
>              Labels: performance
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7389.1.patch, HIVE-7389.2.patch, local_vm_testcase.txt
>
>
> When the number of dynamic partitions to be loaded are high, the time taken for 'MoveTask'
is greater than the actual job in some scenarios.  It would be possible to reduce overall
runtime by reducing the number of calls made to metastore from MoveTask operation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message