hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-16964) _orc_acid_version file is missing
Date Mon, 12 Feb 2018 21:35:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361477#comment-16361477
] 

Eugene Koifman edited comment on HIVE-16964 at 2/12/18 9:34 PM:
----------------------------------------------------------------

This is the layout that {{Hive.moveAcidFiles()}} sees.  It loses {{_orc_acid_version}}
{noformat}
HW13943:ql ekoifman$ tree target/tmp/org.apache.hadoop.hive.ql.TestTxnCommands-1518470371936/warehouse/nonacidorctbl/.hive-staging_hive_2018-02-12_13-26-08_544_7812499075009504959-1/-ext-10000/
target/tmp/org.apache.hadoop.hive.ql.TestTxnCommands-1518470371936/warehouse/nonacidorctbl/.hive-staging_hive_2018-02-12_13-26-08_544_7812499075009504959-1/-ext-10000/
├── 000000_0
│   └── _orc_acid_version
└── 000001_0
    ├── _orc_acid_version
    └── delta_0000016_0000016_0000
        └── bucket_00001

3 directories, 3 files
HW13943:ql ekoifman$ 
{noformat}




was (Author: ekoifman):
This is the layout that {{Hive.moveAcidFiles()}} sees.  It looses {{_orc_acid_version}}
{noformat}
HW13943:ql ekoifman$ tree target/tmp/org.apache.hadoop.hive.ql.TestTxnCommands-1518470371936/warehouse/nonacidorctbl/.hive-staging_hive_2018-02-12_13-26-08_544_7812499075009504959-1/-ext-10000/
target/tmp/org.apache.hadoop.hive.ql.TestTxnCommands-1518470371936/warehouse/nonacidorctbl/.hive-staging_hive_2018-02-12_13-26-08_544_7812499075009504959-1/-ext-10000/
├── 000000_0
│   └── _orc_acid_version
└── 000001_0
    ├── _orc_acid_version
    └── delta_0000016_0000016_0000
        └── bucket_00001

3 directories, 3 files
HW13943:ql ekoifman$ 
{noformat}



> _orc_acid_version file is missing
> ---------------------------------
>
>                 Key: HIVE-16964
>                 URL: https://issues.apache.org/jira/browse/HIVE-16964
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Major
>
> OrcRecordUpdater creates OrcRecordUpdater.ACID_FORMAT in the dir that it creates - but
there is nothing Hive.moveAcidFiles() that copies it final location.
> It doesn't look like CompactorMR even attempts to create it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message