hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Riju Trivedi (Jira)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-23058) Compaction task reattempt fails with FileAlreadyExistsException
Date Wed, 08 Apr 2020 12:00:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Riju Trivedi updated HIVE-23058:
--------------------------------
    Attachment: HIVE-23058.2.patch

> Compaction task reattempt fails with FileAlreadyExistsException
> ---------------------------------------------------------------
>
>                 Key: HIVE-23058
>                 URL: https://issues.apache.org/jira/browse/HIVE-23058
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 3.1.0
>            Reporter: Riju Trivedi
>            Assignee: Riju Trivedi
>            Priority: Major
>         Attachments: HIVE-23058.2.patch, HIVE_23058.1.patch, HIVE_23058.patch
>
>
> Issue occurs when compaction attempt is relaunched after first task attempt failure due
to preemption by Scheduler or any other reason.
> Since _tmp directory was created by first attempt and was left uncleaned after task attempt
failure. Second attempt of the the task fails with "FileAlreadyExistsException" exception.
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.FileAlreadyExistsException):
/warehouse/tablespace/managed/hive/default.db/compaction_test/_tmp_3670bbef-ba7a-4c10-918d-9a2ee17cbd22/base_0000186/bucket_00005
for client 10.xx.xx.xxx already exists



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message