hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "anishek (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
Date Wed, 28 Jun 2017 04:44:02 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065919#comment-16065919
] 

anishek commented on HIVE-16892:
--------------------------------

all the failures are from previous builds except 

* org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23]  : this failure is not
related to the change.

> Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

> -------------------------------------------------------------------------------------
>
>                 Key: HIVE-16892
>                 URL: https://issues.apache.org/jira/browse/HIVE-16892
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2
>    Affects Versions: 3.0.0
>            Reporter: anishek
>            Assignee: anishek
>             Fix For: 3.0.0
>
>         Attachments: HIVE-16892.1.patch, HIVE-16892.2.patch, HIVE-16892.3.patch, HIVE-16892.4.patch
>
>
> during replication boostrap we create the _files via ReplCopyTask for partitions and
tables, this can be done inline as part of analysis phase rather than creating the replCopytask,
> This is done to prevent creation of huge number of these tasks in memory before giving
it to the execution engine. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message