hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (Commented) (JIRA)" <>
Subject [jira] [Commented] (HIVE-2614) Thrift api to know if partition exists or not
Date Wed, 11 Apr 2012 05:18:37 GMT


Amareshwari Sriramadasu commented on HIVE-2614:

bq. @Amareshwari: Can you give a concrete example of a use-case for this new call? In general
I think providing calls like this is a bad idea since it encourages people to accidentally
add time-of-check-to-time-of-use bugs, e.g. HIVE-2938.
Main motivation here is to improve performance of exists check, which would just return boolean
instead of the full partition. The use-case we were looking mainly was filtering i.e. processing
the partitions that do not exists yet and add them.

> Thrift api to know if partition exists or not
> ---------------------------------------------
>                 Key: HIVE-2614
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.9.0
> Currently if we want to know if a partition exists or not, we should call get_partition()
which constructs the partition and returns. This would require joining multiple tables at
the metastore end and it might not scale for many such operations.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message