hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17289) EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
Date Fri, 11 Aug 2017 05:13:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sankar Hariappan updated HIVE-17289:
------------------------------------
    Summary: EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.  (was:
IMPORT should copy files without using doAs user.)

> EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
> ---------------------------------------------------------------------
>
>                 Key: HIVE-17289
>                 URL: https://issues.apache.org/jira/browse/HIVE-17289
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DR, Import, replication
>             Fix For: 3.0.0
>
>
> Currently, IMPORT uses distcp to copy the larger files/large number of files from dump
directory to table staging directory. But, this copy fails as distcp is always done with doAs
user specified in hive.distcp.privileged.doAs, which is "hdfs' by default.
> Need to remove usage of doAs user when try to distcp from IMPORT flow.
> Also, need to set the default config for hive.distcp.privileged.doAs to "hive" as "hdfs"
super-user is never allowed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message