hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HIVE-7389) Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
Date Fri, 11 Jul 2014 10:19:04 GMT

     [ https://issues.apache.org/jira/browse/HIVE-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Balamohan reassigned HIVE-7389:
--------------------------------------

    Assignee: Rajesh Balamohan

> Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-7389
>                 URL: https://issues.apache.org/jira/browse/HIVE-7389
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>              Labels: performance
>         Attachments: HIVE-7389.1.patch, local_vm_testcase.txt
>
>
> When the number of dynamic partitions to be loaded are high, the time taken for 'MoveTask'
is greater than the actual job in some scenarios.  It would be possible to reduce overall
runtime by reducing the number of calls made to metastore from MoveTask operation.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message