hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergio Peña (JIRA) <j...@apache.org>
Subject [jira] [Created] (HIVE-8919) Fix FileUtils.copy() method to call distcp only for HDFS files (not local files)
Date Wed, 19 Nov 2014 23:55:34 GMT
Sergio Peña created HIVE-8919:
---------------------------------

             Summary: Fix FileUtils.copy() method to call distcp only for HDFS files (not
local files)
                 Key: HIVE-8919
                 URL: https://issues.apache.org/jira/browse/HIVE-8919
             Project: Hive
          Issue Type: Sub-task
            Reporter: Sergio Peña
            Assignee: Sergio Peña


When loading a big file (> 32Mb) from the local filesystem to the HDFS filesystem, Hive
fails because the local filesystem cannot load the 'distcp' class.

The 'distcp' class is used only by HDFS filesystem.

We should use distcp only when copying files between the HDFS filesystem.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message