hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Sun <aaron.su...@gmail.com>
Subject Re: Lzo compression on Hive table
Date Fri, 08 Jul 2011 01:17:32 GMT
You can use this one

STORED AS INPUTFORMAT "com.hadoop.mapred.DeprecatedLzoTextInputFormat"
OUTPUTFORMAT "org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat"


On Thu, Jul 7, 2011 at 6:06 PM, <jonathan.hwang@accenture.com> wrote:

> Hi there,
> I got my hadoop all setup writing out sequence file with LZO compression.
>  Using the following:
> mapred.output.compress=true
> mapred.output.compression.codec=com.hadoop.compression.lzo.LzoCodec
>
> How do I define my table so it will write out compressed data and be able
> to read in compressed data during my Hive queries?
>
> CREATE EXTERNAL TABLE foo (
>                       columnA string,
>                       columnB string )
>       PARTITIONED BY (date string)
>       ROW FORMAT DELIMITED FIELDS TERMINATED BY "\t"
>       LOCATION '/path/to/hive/tables/foo';
>
> Thanks,
> Jon
>
> This message is for the designated recipient only and may contain
> privileged, proprietary, or otherwise private information.  If you have
> received it in error, please notify the sender immediately and delete the
> original.  Any other use of the email by you is prohibited.
>

Mime
View raw message