hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (Jira)" <>
Subject [jira] [Commented] (HIVE-22971) Eliminate file rename in insert-only compactor
Date Wed, 20 May 2020 18:52:00 GMT


Hive QA commented on HIVE-22971:

Here are the results of testing the latest attachment:

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:green}SUCCESS:{color} +1 due to 17276 tests passed

Test results:
Console output:
Test logs:

Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase

This message is automatically generated.

ATTACHMENT ID: 13003515 - PreCommit-HIVE-Build

> Eliminate file rename in insert-only compactor
> ----------------------------------------------
>                 Key: HIVE-22971
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Karen Coppage
>            Assignee: Karen Coppage
>            Priority: Major
>              Labels: ACID, compaction
>         Attachments: HIVE-22971.01.patch, HIVE-22971.02.patch, HIVE-22971.03.patch, HIVE-22971.04.patch,
HIVE-22971.05.patch, HIVE-22971.06.patch, HIVE-22971.06.patch, HIVE-22971.06.patch, HIVE-22971.06.patch
> File rename is expensive for object stores, so MM (insert-only) compaction should skip
that step when committing and write directly to base_x_cZ or delta_x_y_cZ.
> This also fixes the issue that for MM QB compaction the temp tables were stored under
the table directory, and these temp dirs were never cleaned up.

This message was sent by Atlassian Jira

View raw message