hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16156) FileSinkOperator should delete existing output target when renaming
Date Thu, 09 Mar 2017 16:22:38 GMT
Xuefu Zhang created HIVE-16156:
----------------------------------

             Summary: FileSinkOperator should delete existing output target when renaming
                 Key: HIVE-16156
                 URL: https://issues.apache.org/jira/browse/HIVE-16156
             Project: Hive
          Issue Type: Bug
          Components: Operators
    Affects Versions: 1.1.0
            Reporter: Xuefu Zhang
            Assignee: Xuefu Zhang


If a task get killed (for whatever a reason) after it completes the renaming the temp output
to final output during commit, subsequent task attempts will fail when renaming because of
the existence of the target output. This can happen, however rarely.

Hive should check the existence of the target output and delete it before renaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message