Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 055A810326 for ; Sun, 9 Jun 2013 09:30:23 +0000 (UTC) Received: (qmail 55332 invoked by uid 500); 9 Jun 2013 09:30:16 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 54899 invoked by uid 500); 9 Jun 2013 09:30:04 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 54882 invoked by uid 99); 9 Jun 2013 09:30:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 09 Jun 2013 09:30:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sachin.hadoop@gmail.com designates 209.85.223.173 as permitted sender) Received: from [209.85.223.173] (HELO mail-ie0-f173.google.com) (209.85.223.173) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 09 Jun 2013 09:29:55 +0000 Received: by mail-ie0-f173.google.com with SMTP id k5so7500409iea.4 for ; Sun, 09 Jun 2013 02:29:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=NUrvxwZz6d2pQ24ocwJUBjkKExoVZcJCCt5GCSD/BjE=; b=gMfV9eC3rMXZrG3cBhHKAyT508KwqJrjmEP98ybk8h+vXfVfESlWgYhiljwfhCp28F SrftQVqiMkSifddqsu8hYeZ2e8tkA4lRs2O17PVfd+MlOTWFqEEVje7YJ6dgj6k4nKve eXQVRuPEnWOVLZDckBmYhWJlqvbFQu3zjhF7dOKwcrlJdokhv9a7YrOypzJCpJWVp6ld +e7tyDipPwb67DVk6zD4NqwKA3vW0YCIjxX/mFNjzHX3RFiQugngt2B9AdJ0v7h4+pmN idxtCGuIZcTGpOWm9xpHGTbm4WleiyfmbkbDwz04yiwG8FMWaZHlQ4wauDsfEFe/UgQ1 5QUg== MIME-Version: 1.0 X-Received: by 10.50.16.102 with SMTP id f6mr2035972igd.41.1370770174361; Sun, 09 Jun 2013 02:29:34 -0700 (PDT) Received: by 10.43.153.4 with HTTP; Sun, 9 Jun 2013 02:29:33 -0700 (PDT) Date: Sun, 9 Jun 2013 14:59:33 +0530 Message-ID: Subject: Compression in Hive using different file formats From: Sachin Sudarshana To: user@hive.apache.org Content-Type: multipart/alternative; boundary=047d7bdc0cf04fc5c104deb54dcc X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc0cf04fc5c104deb54dcc Content-Type: text/plain; charset=ISO-8859-1 Hi, I was testing Compression in Hive using different file formats. I have a table stored as a sequence file ,* facts_normal_seq*. Now I wish to create another table *facts_snappy_seq *by using Snappy compression codec. Is this the correct way to do this: *CREATE TABLE facts_snappy_seq ( , ....) ROW FORMAT.... STORED AS SEQUENCEFILE;* * * *SET hive.exec.compress.output=true;* *SET mapred.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec;* *SET mapred.output.compression.type=BLOCK; * * * *INSERT OVERWRITE TABLE facts_snappy_seq SELECT * FROM facts_normal_seq;* * * When i populate the table in this manner, the file in HDFS doesn not seem to have the .snappy extension. Any pointers in this regard would really be helpful Thank you, Sachin --047d7bdc0cf04fc5c104deb54dcc Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,

I was testing Compression in Hive using different fi= le formats.

I have a table stored as a sequence fi= le , facts_normal_seq.

Now I wish to= create another table facts_snappy_seq by using Snappy compre= ssion codec.

Is this the correct way to do this:

CREATE TABLE facts_snappy_seq (<column1> , <column2>= ; ....) ROW FORMAT.... STORED AS SEQUENCEFILE;

SET hive.exec.compress.output=3Dtrue;
SET mapred.output.compression.codec=3Dorg.apache.hadoop.io.comp= ress.SnappyCodec;
SET mapred.output.compression.typ= e=3DBLOCK;=A0

INSERT OVERWRITE TABLE facts_snappy= _seq SELECT * FROM facts_normal_seq;

When i populate the table in this manner, the file in HDFS doesn n= ot seem to have the .snappy extension.

Any pointers in this regard would really be helpful

Thank you,
Sachin=A0
--047d7bdc0cf04fc5c104deb54dcc--