hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Yang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1238) Get partitions with a partial specification
Date Thu, 11 Mar 2010 03:03:31 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12843884#action_12843884
] 

Paul Yang commented on HIVE-1238:
---------------------------------

A couple of possibilities here:

1. Add 2 new functions to allow filtering of returned partitions with a supplied partition
spec. Disadvantage is that it will add to the growing number of functions in the metastore
API, and may result in redundant functionality.

{code}
  // get_partition_mp methods allow filtering by matching a partial partition 
  // specification, as needed for dynamic partitions
  list<Partition> get_partitions_mp(1:string db_name 2:string tbl_name 
  	3:list<string> part_vals, 4:i16 max_parts=-1)
  list<string> get_partitions_mp_by_name(1:string db_name, 
  	2:string tbl_name, 3:list<string> part_vals, 4:i16 max_parts=-1)
{code}

2. Alter the signature of existing methods to allow specification of a partial partition spec.
An empty partition spec means 'return all'. Disadvantage is that it may break existing apps
once the new libraries are deployed.

{code}
  // get_partition_mp methods allow filtering by matching a partial partition 
  // specification, as needed for dynamic partitions
  list<Partition> get_partitions_mp(1:string db_name 2:string tbl_name 
  	3:list<string> part_vals, 4:i16 max_parts=-1)
  list<string> get_partitions_mp_by_name(1:string db_name, 
  	2:string tbl_name, 3:list<string> part_vals, 4:i16 max_parts=-1)
{code}

> Get  partitions with a partial specification
> --------------------------------------------
>
>                 Key: HIVE-1238
>                 URL: https://issues.apache.org/jira/browse/HIVE-1238
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Paul Yang
>            Assignee: Paul Yang
>             Fix For: 0.6.0
>
>
> Currently, the metastore API only allows retrieval of all the partitions of a table,
or the retrieval of a single partition given a complete partition specification. For HIVE-936,
a method to retrieve all partitions that match a partial partition specification would be
useful. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message