hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alina Abramova (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13703) "msck repair" on table with non-partition subdirectories reporting partitions not in metastore
Date Mon, 19 Sep 2016 16:00:23 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alina Abramova updated HIVE-13703:
----------------------------------
    Attachment: HIVE-13703.patch

This patch fixes this issue. Could somebody review  it?

> "msck repair" on table with non-partition subdirectories reporting partitions not in
metastore
> ----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-13703
>                 URL: https://issues.apache.org/jira/browse/HIVE-13703
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 0.14.0, 1.0.0, 1.2.1
>            Reporter: Ana Gillan
>            Assignee: Alina Abramova
>         Attachments: HIVE-13703.patch
>
>
> PROBLEM: Subdirectories created with UNION ALL are listed in {{show partitions}} output,
but show up as {{Partitions not in metastore}} in {{msck repair}} output. 
> STEPS TO REPRODUCE: Table created from {{CTAS ... UNION ALL}} DDL
> {code}
> hive> msck repair table meter_001; 
> OK 
> Partitions not in metastore: meter_001:tech_datestamp=2016-03-09/1 meter_001:tech_datestamp=2016-03-09/2
meter_001:tech_datestamp=2016-03-10/1 meter_001:tech_datestamp=2016-03-10/2 meter_001:tech_datestamp=2016-03-11/1
meter_001:tech_datestamp=2016-03-11/2 meter_001:tech_datestamp=2016-03-12/1 meter_001:tech_datestamp=2016-03-12/2
meter_001:tech_datestamp=2016-03-13/1 meter_001:tech_datestamp=2016-03-13/2 meter_001:tech_datestamp=2016-03-14/1
meter_001:tech_datestamp=2016-03-14/2 meter_001:tech_datestamp=2016-03-15/1 meter_001:tech_datestamp=2016-03-15/2
meter_001:tech_datestamp=2016-03-16/1 meter_001:tech_datestamp=2016-03-16/2 meter_001:tech_datestamp=2016-03-17/1
meter_001:tech_datestamp=2016-03-17/2 meter_001:tech_datestamp=2016-03-18/1 meter_001:tech_datestamp=2016-03-18/2
meter_001:tech_datestamp=2016-03-19/1 meter_001:tech_datestamp=2016-03-19/2 meter_001:tech_datestamp=2016-03-20/1
meter_001:tech_datestamp=2016-03-20/2 meter_001:tech_datestamp=2016-03-21/1 meter_001:tech_datestamp=2016-03-21/2
meter_001:tech_datestamp=2016-03-22/1 meter_001:tech_datestamp=2016-03-22/2 meter_001:tech_datestamp=2016-03-23/1
meter_001:tech_datestamp=2016-03-23/2 meter_001:tech_datestamp=2016-03-24/1 meter_001:tech_datestamp=2016-03-24/2
meter_001:tech_datestamp=2016-03-25/1 meter_001:tech_datestamp=2016-03-25/2 meter_001:tech_datestamp=2016-03-26/1
meter_001:tech_datestamp=2016-03-26/2 meter_001:tech_datestamp=2016-03-27/1 meter_001:tech_datestamp=2016-03-27/2
meter_001:tech_datestamp=2016-03-28/1 meter_001:tech_datestamp=2016-03-28/2 meter_001:tech_datestamp=2016-03-29/1
meter_001:tech_datestamp=2016-03-29/2 meter_001:tech_datestamp=2016-03-30/1 meter_001:tech_datestamp=2016-03-30/2
meter_001:tech_datestamp=2016-03-31/1 meter_001:tech_datestamp=2016-03-31/2 meter_001:tech_datestamp=2016-04-01/1
meter_001:tech_datestamp=2016-04-01/2 meter_001:tech_datestamp=2016-04-02/1 meter_001:tech_datestamp=2016-04-02/2
meter_001:tech_datestamp=2016-04-03/1 meter_001:tech_datestamp=2016-04-03/2 meter_001:tech_datestamp=2016-04-04/1
meter_001:tech_datestamp=2016-04-04/2 meter_001:tech_datestamp=2016-04-05/1 meter_001:tech_datestamp=2016-04-05/2
meter_001:tech_datestamp=2016-04-06/1 meter_001:tech_datestamp=2016-04-06/2 
> Time taken: 15.996 seconds, Fetched: 1 row(s) 
> {code}
> {code}
> hive> show partitions meter_001; 
> OK 
> tech_datestamp=2016-03-09 
> tech_datestamp=2016-03-10 
> tech_datestamp=2016-03-11 
> tech_datestamp=2016-03-12 
> tech_datestamp=2016-03-13 
> tech_datestamp=2016-03-14 
> tech_datestamp=2016-03-15 
> tech_datestamp=2016-03-16 
> tech_datestamp=2016-03-17 
> tech_datestamp=2016-03-18 
> tech_datestamp=2016-03-19 
> tech_datestamp=2016-03-20 
> tech_datestamp=2016-03-21 
> tech_datestamp=2016-03-22 
> tech_datestamp=2016-03-23 
> tech_datestamp=2016-03-24 
> tech_datestamp=2016-03-25 
> tech_datestamp=2016-03-26 
> tech_datestamp=2016-03-27 
> tech_datestamp=2016-03-28 
> tech_datestamp=2016-03-29 
> tech_datestamp=2016-03-30 
> tech_datestamp=2016-03-31 
> tech_datestamp=2016-04-01 
> tech_datestamp=2016-04-02 
> tech_datestamp=2016-04-03 
> tech_datestamp=2016-04-04 
> tech_datestamp=2016-04-05 
> tech_datestamp=2016-04-06 
> Time taken: 0.417 seconds, Fetched: 29 row(s) 
> {code}
> Ideally msck repair should ignore subdirectory if that additional partition column doesn't
exist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message