hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saurabh Nanda <saurabhna...@gmail.com>
Subject Re: Output compression not working on hive-trunk (r802989)
Date Fri, 14 Aug 2009 04:06:47 GMT
> hive.exec.compress.output=true is the correct option. Can you post the
> "insert" command that you run which produced non-compressed results?
> Is the output in TextFileFormat or SequenceFileFormat?


Here's the query. raw_compressed is a SequenceFile table with raw lines. raw
is a SequenceFile table with separate columns for each data field.

from raw_compressed
    insert overwrite table raw partition (dt='2009-04-02')
    select transform(line) using 'parse_logs.rb' as ip_address, aid, uid,
ts, method, uri, response, referer, user_agent, cookies, ptime

Saurabh.
-- 
http://nandz.blogspot.com
http://foodieforlife.blogspot.com

Mime
View raw message