hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nirav Patel <npa...@xactlycorp.com>
Subject Wildcard and Automatic partitioning
Date Thu, 03 Aug 2017 18:00:35 GMT
Hi, is there a way in hive when I create an external table I can specify
wild card in LOCATION and have hive automatically identify partitions.

I have opened HIVE-17236 <https://issues.apache.org/jira/browse/HIVE-17236> for
wildcard support. same time I also have issue of specifying partitions.  I
can use tedious ALTER TABLE to add partition directory. But since data
already exist in separate partition why can't hive identify it ?

Here's such example of a directory:
/user/mycomp/customers/*/departments/partition/*

I can have n number of customer and for each m number of partition for
departments object.

I think if I use following sql to create external table then it should be
able to identify all the partitions.

CREATE EXTERNAL TABLE testTable (val map<string, string>)
PARTITIONED BY (period string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LOCATION '/user/mycomp/customers/*/departments/partition/*';

If my partition directory (lets say p-12345) have multiple files insides it
that doesn't start with "part-" prefix then I should be able to specify
that prefix so hive can find the right filesets.

Thanks

-- 


[image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>

<https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn] 
<https://www.linkedin.com/company/xactly-corporation>  [image: Twitter] 
<https://twitter.com/Xactly>  [image: Facebook] 
<https://www.facebook.com/XactlyCorp>  [image: YouTube] 
<http://www.youtube.com/xactlycorporation>

Mime
View raw message