hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark <static.void....@gmail.com>
Subject Re: Noob question on creating tables
Date Fri, 29 Mar 2013 18:16:01 GMT
Thanks

Does this mean I need to create a partition for each day manually? There is no way to have
infer that from my directory structure?

On Mar 29, 2013, at 10:32 AM, Dean Wampler <dean.wampler@thinkbiganalytics.com> wrote:

> 
> 
> On Fri, Mar 29, 2013 at 12:19 PM, Mark <static.void.dev@gmail.com> wrote:
> We have existing log data in directories in the format of YEAR/MONTH/DAY.
> 
> - How can we create a table over this table without hive modifying and/or moving it?
> 
> create external table foo (...) partitioned by (year  int, month int, day int);
> ...
> 
> - How can we tell Hive to partition this data so it knows about each day of logs?
> 
> alter table foo add partition(year = 2013, month = 3, day = 29) location '/path/to/2013/03/29';
>  
> - Does hive out of the box work with reading compressed files?
> 
> yes, if you're using a compression scheme supported by Hadoop.
>  
> 
> Thanks
> 
> 
> 
> -- 
> Dean Wampler, Ph.D.
> thinkbiganalytics.com
> +1-312-339-1330
> 


Mime
View raw message