hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3300) LOAD DATA INPATH fails if a hdfs file with same name is added to table
Date Mon, 17 Dec 2012 11:34:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533867#comment-13533867
] 

Phabricator commented on HIVE-3300:
-----------------------------------

njain has commented on the revision "HIVE-3300 [jira] LOAD DATA INPATH fails if a hdfs file
with same name is added to table".

INLINE COMMENTS
  ql/src/test/queries/clientpositive/load_fs2.q:1 Add some comments in the test.
  What are you trying to test ?

REVISION DETAIL
  https://reviews.facebook.net/D4383

To: JIRA, navis
Cc: njain

                
> LOAD DATA INPATH fails if a hdfs file with same name is added to table
> ----------------------------------------------------------------------
>
>                 Key: HIVE-3300
>                 URL: https://issues.apache.org/jira/browse/HIVE-3300
>             Project: Hive
>          Issue Type: Bug
>          Components: Import/Export
>    Affects Versions: 0.10.0
>         Environment: ubuntu linux, hadoop 1.0.3, hive 0.9
>            Reporter: Bejoy KS
>            Assignee: Navis
>         Attachments: HIVE-3300.1.patch.txt, HIVE-3300.D4383.3.patch
>
>
> If we are loading data from local fs to hive tables using 'LOAD DATA LOCAL INPATH' and
if a file with the same name exists in the table's location then the new file will be suffixed
by *_copy_1.
> But if we do the 'LOAD DATA INPATH'  for a file in hdfs then there is no rename happening
but just a move task is getting triggered. Since a file with same name exists in same hdfs
location, hadoop fs move operation throws an error.
> hive> LOAD DATA INPATH '/userdata/bejoy/site.txt' INTO TABLE test.site;
> Loading data to table test.site
> Failed with exception null
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
> hive> 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message