hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Weeks (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-7429) Set replication for archive called before file exists
Date Wed, 16 Jul 2014 20:07:04 GMT
Daniel Weeks created HIVE-7429:
----------------------------------

             Summary: Set replication for archive called before file exists
                 Key: HIVE-7429
                 URL: https://issues.apache.org/jira/browse/HIVE-7429
             Project: Hive
          Issue Type: Bug
    Affects Versions: 0.13.1, 0.13.0, 0.12.0, 0.11.0, 0.14.0
            Reporter: Daniel Weeks
            Priority: Critical


The call to set replication is called prior to uploading the archive file to hdfs, which does
not throw an error, but the replication never gets set.

This has a significant impact on large jobs (especially hash joins) due to too many tasks
hitting the data nodes.





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message