hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13572) Redundant setting full file status in Hive::copyFiles
Date Thu, 28 Apr 2016 20:51:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262955#comment-15262955
] 

Ashutosh Chauhan commented on HIVE-13572:
-----------------------------------------

I think setting perms in FS might be a bigger change. [~ruili] Shall we check this one in
while you work on FS changes. I am +1 on current patch.

> Redundant setting full file status in Hive::copyFiles
> -----------------------------------------------------
>
>                 Key: HIVE-13572
>                 URL: https://issues.apache.org/jira/browse/HIVE-13572
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-13572.1.patch, HIVE-13572.2.patch
>
>
> We set full file status in each copy-file thread. I think it's redundant and hurts performance
when we have multiple files to copy.
> {code}
>             if (inheritPerms) {
>               ShimLoader.getHadoopShims().setFullFileStatus(conf, fullDestStatus, destFs,
destf);
>             }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message