hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohit Sikri (JIRA)" <>
Subject [jira] Commented: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name
Date Tue, 08 Feb 2011 12:45:57 GMT


Mohit Sikri commented on HIVE-307:

Hello Namit/Kirk/He Yongqiang,

I was evaluating this defect, but it seems it is incomplete(falling short) of its cause.
It should also work fine for queries like

LOAD DATA INPATH './kv2.txt' INTO TABLE tst_src1;

But unfortunately :-( it is failing, giving null pointer exception in copyFiles() method [].
I tested it against Hive0.7 snapshot of the latest build.

The difference between the query present in the test case and the one I mentioned   is the
Path from which kv2.txt is fetched, the source path in former is a hdfs temp directory(say
/tmp/hive-root/2097947077/10000 under which kv2.txt is present) whereas in the later it is
a hdfs file which is being actually referred. 

So the changes i.e. renaming done by checkPaths() method to avoid conflict is not visible
outside it's scope ;i.e. not detected by fs.listStatus() where in actual the renamed file(say
/user/root/kv2.txt_copy_1) is moved to tst_src1 warehouse (say /user/hive/warehouse/tst_src1).

Kindly confirm, so that I can raise a new bug or re-open the existing one.

> "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name
> --------------------------------------------------------------------------------------
>                 Key: HIVE-307
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.5.0, 0.6.0
>            Reporter: Zheng Shao
>            Assignee: Kirk True
>            Priority: Critical
>             Fix For: 0.7.0
>         Attachments: HIVE-307.patch, HIVE-307.patch, HIVE-307.v3.patch, hive-307.1.svn.patch
> Failed with exception checkPaths: /user/zshao/warehouse/tmp_user_msg_history/test_user_msg_history
already exists
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

This message is automatically generated by JIRA.
For more information on JIRA, see:


View raw message