hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-14895) CompactorMR.CompactorOutputCommitter race condition
Date Sun, 04 Dec 2016 18:43:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eugene Koifman updated HIVE-14895:
----------------------------------
    Status: Open  (was: Patch Available)

> CompactorMR.CompactorOutputCommitter race condition
> ---------------------------------------------------
>
>                 Key: HIVE-14895
>                 URL: https://issues.apache.org/jira/browse/HIVE-14895
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>         Attachments: HIVE-14895.01.patch
>
>
> commitJob() method renames each file in TMP_LOCATION separately.  so someone may read
FINAL_LOCATION and see only some of the files that should be there.
> Use FileSystem.getFileStatus(TMP_LOCATION) and just rename the dir.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message