hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "anishek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16894) Multi-threaded execution of bootstrap dump of tables.
Date Wed, 14 Jun 2017 08:55:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

anishek updated HIVE-16894:
---------------------------
    Description: 
after completing HIVE-16893 the bootstrap process will dump single table at a time and hence
will be very time consuming while not optimally utilizing the available resources. Since there
is no dependency between dumps of various tables we should be able to do this in parallel.

Bootstrap dump at db level does :
* boostrap of all tables (scope of current jira) 
** boostrap of all partitions in a table. 
* boostrap of all functions


  was:
after completing HIVE-16893 the bootstrap process will dump single table at a time and hence
will be very time consuming while not optimally utilizing the available resources. 

Bootstrap dump at db level does :
* boostrap of all tables (scope of current jira) 
** boostrap of all partitions in a table. 
* boostrap of all functions



> Multi-threaded execution of bootstrap dump of tables. 
> ------------------------------------------------------
>
>                 Key: HIVE-16894
>                 URL: https://issues.apache.org/jira/browse/HIVE-16894
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>    Affects Versions: 3.0.0
>            Reporter: anishek
>            Assignee: anishek
>             Fix For: 3.0.0
>
>
> after completing HIVE-16893 the bootstrap process will dump single table at a time and
hence will be very time consuming while not optimally utilizing the available resources. Since
there is no dependency between dumps of various tables we should be able to do this in parallel.
> Bootstrap dump at db level does :
> * boostrap of all tables (scope of current jira) 
> ** boostrap of all partitions in a table. 
> * boostrap of all functions



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message