hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chinna Rao Lalam (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HIVE-3033) Loading data from a file in hdfs to hive table is failing if we try to load the same file into the same table second time
Date Mon, 10 Mar 2014 13:29:43 GMT

     [ https://issues.apache.org/jira/browse/HIVE-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chinna Rao Lalam resolved HIVE-3033.
------------------------------------

    Resolution: Not A Problem

This is not an issue with current current code base..

> Loading data from a file in hdfs to hive table is failing if we try to load the same
file into the same table second time
> -------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-3033
>                 URL: https://issues.apache.org/jira/browse/HIVE-3033
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.8.1, 0.9.0, 0.9.1
>            Reporter: Kristam Subba Swathi
>            Assignee: Chinna Rao Lalam
>         Attachments: HIVE-3033.patch
>
>
> Steps to reproduce
> ---------------------
> 1)create table in hive
> create table emp(IP STRING,showtime double) ROW FORMAT DELIMITED FIELDS TERMINATED BY
'\040'
> 2)load data into the table
> LOAD DATA INPATH '/hive/input/data2.txt' OVERWRITE INTO TABLE emp
> LOAD DATA INPATH '/hive/input/data2.txt' OVERWRITE INTO TABLE emp
> Loading the same file into the same table is failing 
> {noformat}
> 2012-05-11 19:28:54,415 DEBUG metadata.Hive (Hive.java:checkPaths(1937)) - Successfully
renamed hdfs://10.18.40.25:54310/HiveNFT_testLoadDataShouldOverWriteIfSameFileAlreadyExistsInTableByGivingTheRooTPath/data2.txt
to hdfs://10.18.40.25:54310/HiveNFT_testLoadDataShouldOverWriteIfSameFileAlreadyExistsInTableByGivingTheRooTPath/data2_copy_3.txt
> 2012-05-11 19:28:54,416 DEBUG ipc.Client (Client.java:sendParam(786)) - IPC Client (32955489)
connection to HOST-10-18-40-25/10.18.40.25:54310 from root sending #5749
> 2012-05-11 19:28:54,416 DEBUG ipc.Client (Client.java:receiveResponse(821)) - IPC Client
(32955489) connection to HOST-10-18-40-25/10.18.40.25:54310 from root got value #5749
> 2012-05-11 19:28:54,417 DEBUG ipc.RPC (WritableRpcEngine.java:invoke(197)) - Call: getFileInfo
2
> 2012-05-11 19:28:54,417 DEBUG ipc.Client (Client.java:sendParam(786)) - IPC Client (32955489)
connection to HOST-10-18-40-25/10.18.40.25:54310 from root sending #5750
> 2012-05-11 19:28:54,419 DEBUG ipc.Client (Client.java:receiveResponse(821)) - IPC Client
(32955489) connection to HOST-10-18-40-25/10.18.40.25:54310 from root got value #5750
> 2012-05-11 19:28:54,419 DEBUG ipc.RPC (WritableRpcEngine.java:invoke(197)) - Call: getListing
2
> 2012-05-11 19:28:54,420 ERROR exec.Task (SessionState.java:printError(380)) - Failed
with exception copyFiles: error while moving files!!!
> org.apache.hadoop.hive.ql.metadata.HiveException: copyFiles: error while moving files!!!
> 	at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:1989)
> 	at org.apache.hadoop.hive.ql.metadata.Table.copyFiles(Table.java:547)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1283)
> 	at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:234)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> 	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
> 	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
> 	at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:191)
> 	at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:629)
> 	at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:617)
> 	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
> 	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
> 	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:619)
> Caused by: java.io.FileNotFoundException: File hdfs://10.18.40.25:54310/HiveNFT_testLoadDataShouldOverWriteIfSameFileAlreadyExistsInTableByGivingTheRooTPath/data2.txt
does not exist.
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:353)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:1979)
> 	... 17 more
> {noformat}
>  



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message