hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16918) Skip ReplCopyTask distcp for _metadata copying. Also enable -pb for distcp
Date Mon, 19 Jun 2017 17:35:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sushanth Sowmyan updated HIVE-16918:
------------------------------------
    Status: Patch Available  (was: Open)

> Skip ReplCopyTask distcp for _metadata copying. Also enable -pb for distcp
> --------------------------------------------------------------------------
>
>                 Key: HIVE-16918
>                 URL: https://issues.apache.org/jira/browse/HIVE-16918
>             Project: Hive
>          Issue Type: Bug
>          Components: repl
>    Affects Versions: 3.0.0
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-16918.patch
>
>
> With HIVE-16686, we switched ReplCopyTask to always use a privileged DistCp. This, however,
is incorrect for copying _metadata generated from a temporary scratch directory to hdfs. We
need to change that so that routes to using a regular CopyTask.
> Also, in the spirit of following up HIVE-16686, we missed adding "-pb" as a default for
invocations of distcp from hive. Adding that in. This would not be necessary if HADOOP-8143
had made it in, but till it doesn't go in, we need it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message