hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sushil Ks <sushil...@gmail.com>
Subject Re: MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase
Date Mon, 26 Sep 2016 13:58:22 GMT
There's a typo while sharing the example, it's not *mypartitiondate *instead
its *mypartition *when it got added.

On Mon, Sep 26, 2016 at 5:32 PM, Sushil Ks <sushil416@gmail.com> wrote:

> Hi,
>
>    I feel thers is a bug while running MSCK REPAIR TABLE
> EXTERNAL_TABLE_NAME on Hive 1.2.1, all the partition that are not present
> in the metastore are being listed but not added if the partition names are
> not in lowercase, in other words if an external path has a camel case based
> name and value i.e s3n://some_external_path/myPartition=01 it just gets
> listed as partition not found in metastore but doesn’t add it.
>
> *For Instance:*
>
> - When external path = s3n://some_external_path/myPartition=01
>
>        hive> MSCK REPAIR TABLE my_external_table;
>
>        Partitions not in metastore: my_external_table:mypartition=01
>
>        Time taken: 1.729 seconds, Fetched: 2 row(s)
>
>
>         hive> show partitions foster.ola_raven_raven_users_raw;
>
>         OK
>
>         Time taken: 0.901 seconds, Fetched: 0 row(s)
>
>
> - When external path = s3n://some_external_path/mypartition=01
>
>         hive> MSCK REPAIR TABLE my_external_table;
>
>         Partitions not in metastore: my_external_table:mypartitiondate=01
>
>         Repair: Added partition to metastore my_external_table:
> mypartitiondate=01
>
>         Time taken: 1.729 seconds, Fetched: 2 row(s)
>
>
>          hive> show partitions my_external_table;
>
>          OK
>
>          mypartition=01
>
>          Time taken: 1.101 seconds, Fetched: 1 row(s)
>
>
>           I wanted to know if this is considered as bug and fixed, else
> would be happy to fix it.
>
>
> Regards,
> Sushil Ks
>

Mime
View raw message