hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Created] (HIVE-18644) archived partitions check is very slow
Date Wed, 07 Feb 2018 01:27:00 GMT
Sergey Shelukhin created HIVE-18644:

             Summary: archived partitions check is very slow
                 Key: HIVE-18644
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin

See ArchiveUtils. 
Does # of affected partitions x # of part keys calls to metastore.
This can take insane amount of time for a feature that I've never seen anyone actually use.
At the very least, we should have an API on metastore that will return list of tables with
archived partitions, to be able to skip these checks after one MS call if we know that the
table doesn't have any.
Or we could remove the feature altogether ;)

This message was sent by Atlassian JIRA

View raw message