hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sushil Ks <sushil...@gmail.com>
Subject MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase
Date Mon, 26 Sep 2016 12:02:21 GMT
Hi,

   I feel thers is a bug while running MSCK REPAIR TABLE
EXTERNAL_TABLE_NAME on Hive 1.2.1, all the partition that are not present
in the metastore are being listed but not added if the partition names are
not in lowercase, in other words if an external path has a camel case based
name and value i.e s3n://some_external_path/myPartition=01 it just gets
listed as partition not found in metastore but doesn’t add it.

*For Instance:*

- When external path = s3n://some_external_path/myPartition=01

       hive> MSCK REPAIR TABLE my_external_table;

       Partitions not in metastore: my_external_table:mypartition=01

       Time taken: 1.729 seconds, Fetched: 2 row(s)


        hive> show partitions foster.ola_raven_raven_users_raw;

        OK

        Time taken: 0.901 seconds, Fetched: 0 row(s)


- When external path = s3n://some_external_path/mypartition=01

        hive> MSCK REPAIR TABLE my_external_table;

        Partitions not in metastore: my_external_table:mypartitiondate=01

        Repair: Added partition to metastore
my_external_table:mypartitiondate=01

        Time taken: 1.729 seconds, Fetched: 2 row(s)


         hive> show partitions my_external_table;

         OK

         mypartition=01

         Time taken: 1.101 seconds, Fetched: 1 row(s)


          I wanted to know if this is considered as bug and fixed, else
would be happy to fix it.


Regards,
Sushil Ks

Mime
View raw message