hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Julien Ros <julien....@free.fr>
Subject Help on Partition Utilisation on S3
Date Thu, 03 Jul 2014 10:04:15 GMT
Hello,

I have on Amazon S3 avro log files stored with the following structure:
s3://hive/logs/year/month/day

When I create a table with:
CREATE EXTERNAL TABLE log
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
LOCATION 's3://hive/logs/2014/06/22'
TBLPROPERTIES (
'avro.schema.url'='s3n://hive/schemas/logs.avsc'
);

All work fine, I can query my table. However, when I try to use partitioned table (only on
the day) with:

CREATE EXTERNAL TABLE log PARTITIONED BY (day STRING)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS
INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
LOCATION 's3://hive/logs/2014/06/'
TBLPROPERTIES (
'avro.schema.url'='s3n://hive/schemas/logs.avsc'
);
ALTER TABLE log ADD PARTITION (day='22') location 's3://hive/logs/2014/06/22/';

all queries return this error:
hive> select * from log;
OK
Failed with exception java.io.IOException:java.lang.RuntimeException: Hive internal error:
conversion of string to array<struct<……………………….>>not supported
yet.
Time taken: 3.808 seconds


Please help

Thanks

Julien
Mime
View raw message