hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2614) Thrift api to know if partition exists or not
Date Wed, 11 Apr 2012 05:18:37 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251329#comment-13251329
] 

Amareshwari Sriramadasu commented on HIVE-2614:
-----------------------------------------------

bq. @Amareshwari: Can you give a concrete example of a use-case for this new call? In general
I think providing calls like this is a bad idea since it encourages people to accidentally
add time-of-check-to-time-of-use bugs, e.g. HIVE-2938.
Main motivation here is to improve performance of exists check, which would just return boolean
instead of the full partition. The use-case we were looking mainly was filtering i.e. processing
the partitions that do not exists yet and add them.

                
> Thrift api to know if partition exists or not
> ---------------------------------------------
>
>                 Key: HIVE-2614
>                 URL: https://issues.apache.org/jira/browse/HIVE-2614
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.9.0
>
>
> Currently if we want to know if a partition exists or not, we should call get_partition()
which constructs the partition and returns. This would require joining multiple tables at
the metastore end and it might not scale for many such operations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message