hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen O'Malley <owen.omal...@gmail.com>
Subject Re: can OrcSerde work with custom input format
Date Sat, 25 Jul 2015 02:01:58 GMT
Using OrcSerde should work fine.

.. Owen

> On Jul 24, 2015, at 17:39, Jie Zhang <jiezh2008@gmail.com> wrote:
> 
> Hi, 
> 
> My application is using hive extenal tables with ORC and needs some special logic to
filter out some input files. I was thinking to write a custom InputFormat extending OrcInputFormat.

> 
> create external table test1 (...) 
> 
> ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
> 
> STORED AS INPUTFORMAT 'MyFilteredOrcInputFormat'
> 
> OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
> 
> location 'file:///Users/{username}/Documents/test1';
> 
> 
> 
> However, the custom input format is in effect at all. I wonder whether OrcSerde can work
with custom input format. Or should I write a custom serde extending OrcSerde? Any insight
is appreciated. Thanks very much!
> 
> Jessica

Mime
View raw message