Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D5F2710FB5 for ; Fri, 1 May 2015 15:23:03 +0000 (UTC) Received: (qmail 98284 invoked by uid 500); 1 May 2015 15:22:58 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 98164 invoked by uid 500); 1 May 2015 15:22:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 98013 invoked by uid 99); 1 May 2015 15:22:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2015 15:22:58 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,MIME_QP_LONG_LINE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which is an MX secondary for user@hadoop.apache.org) Received: from [54.76.25.247] (HELO mx1-eu-west.apache.org) (54.76.25.247) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2015 15:22:26 +0000 Received: from mail-pa0-f44.google.com (mail-pa0-f44.google.com [209.85.220.44]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 7E4FE2D205 for ; Fri, 1 May 2015 15:22:24 +0000 (UTC) Received: by pacyx8 with SMTP id yx8so93481361pac.1 for ; Fri, 01 May 2015 08:21:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:references:in-reply-to:to; bh=YYzoq+Kelvl5Y8/IyDEHw9ZnafYamRET59T+eJ0bGK0=; b=KiqN9+O0BdiVG7hQ+ocPjCHfWybDFBTiK1Iarje+tKp1+z0NQzRHUXZ+0TAjN/qR3x 7F2YzZbRXBxX4PFqNvtCmHTrsmwKbkusw7NbjvkhLUhGftL4OT6JspH2O/OqK15seJQd pmxpvVKUvzAT2p8mDuvJKVGrC5Scs0Fi+SfIe2SEsAczAB+bUPQpt6Vr2dkX+f5BZWH4 qXEO9V9M8plDvYURoI047VgVv6cMU1X3BJ0SXmM2BTAV0PT6WwEKhyOg4SrKyhwp79MB hf0xYwuajmYxHgFZBDfpwourKFSoR6uQ6fu4ErE46We7me6vavBnWb3GTrgEmyKSTYXH +H1g== X-Received: by 10.70.56.98 with SMTP id z2mr18441230pdp.120.1430493691907; Fri, 01 May 2015 08:21:31 -0700 (PDT) Received: from [10.124.197.72] ([166.170.44.90]) by mx.google.com with ESMTPSA id qz3sm5169413pab.19.2015.05.01.08.21.30 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 01 May 2015 08:21:31 -0700 (PDT) From: Hadoop User Content-Type: multipart/alternative; boundary=Apple-Mail-C1711F17-F7F4-43A8-BBB2-0735A4B8590C Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Subject: Re: parque table Message-Id: Date: Fri, 1 May 2015 08:21:29 -0700 References: In-Reply-To: To: "user@hadoop.apache.org" X-Mailer: iPhone Mail (12F70) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-C1711F17-F7F4-43A8-BBB2-0735A4B8590C Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Here is the content of the file once it's unzip 106,"2003-02-03",20,2,"A","2","2","037" 106,"2003-02-03",20,3,"A","2","2","037" 106,"2003-02-03",8,2,"A","2","2","037" > On May 1, 2015, at 7:32 AM, Asit Parija wrote:= >=20 > Hi Kumar , > You can remove the stored as text file part and then try that out by def= ault it should be able to read the .gz files ( if they are comma delimited c= sv files ) . >=20 >=20 > Thanks > Asit >=20 >> On Fri, May 1, 2015 at 10:55 AM, Kumar Jayapal wro= te: >> Hello Nitin, >>=20 >> Dint understand what you mean. Are you telling me to set COMPRESSION_COD= EC=3Dgzip ? >>=20 >> thanks >> Jay >>=20 >>> On Thu, Apr 30, 2015 at 10:02 PM, Nitin Pawar w= rote: >>> You loaded a gz file in a table stored as text file >>> either define compression format or uncompress the file and load it=20 >>>=20 >>>> On Fri, May 1, 2015 at 9:17 AM, Kumar Jayapal wr= ote: >>>> Created table CREATE TABLE raw (line STRING) PARTITIONED BY (FISCAL_YE= AR smallint, FISCAL_PERIOD smallint) >>>> STORED AS TEXTFILE; >>>>=20 >>>> and loaded it with data. >>>>=20 >>>> LOAD DATA LOCAL INPATH '/tmp/weblogs/20090603-access.log.gz' INTO TABLE= raw; >>>>=20 >>>> I have to load it to parque table >>>>=20 >>>> when I say select * from raw it shows all null values. >>>>=20 >>>>=20 >>>> NULL NULL NULL NULL NULL NULL NULL NULL >>>>=20 >>>> NULL NULL NULL NULL NULL NULL NULL NULL >>>>=20 >>>> NULL NULL NULL NULL NULL NULL NULL NULL >>>>=20 >>>> NULL NULL NULL NULL NULL NULL NULL NULL >>>> Why is not show showing the actual data in file. will it show once I lo= ad it to parque table? >>>>=20 >>>> Please let me know if I am doing anything wrong. >>>>=20 >>>>=20 >>>> Thanks >>>> jay=20 >>>=20 >>>=20 >>>=20 >>> --=20 >>> Nitin Pawar >=20 --Apple-Mail-C1711F17-F7F4-43A8-BBB2-0735A4B8590C Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Here is the content of the file once i= t's unzip

106,"2003-02-03",20,2,"A","2","2","037"
106,"2003-02-03",20,= 3,"A","2","2","037"
106,"2003-02-03",8,2,"A","2","2","037"
<= br>




On May 1, 201= 5, at 7:32 AM, Asit Parija <= asit@sigmoidanalytics.com> wrote:

Hi Kumar ,
  You can remove the stored as= text file part and then try that out by default it should be able to read t= he .gz files ( if they are comma delimited csv files ) .


Thanks
Asit

On Fri, May 1, 2015 at 10:55 AM, Kumar J= ayapal <kjayapal17@gmail.com> wrote:
Hello Nitin,

Dint understand wh= at you mean. Are you telling me to  set COMPRESSION_CODEC=3Dgzip ?=

thanks
Jay

On Thu, Apr 30, 2015 at 10:02 PM, Nitin Pawar <nitinpawar432@gmail= .com> wrote:
You loaded a gz file in a table stored as text file
either define compr= ession format or uncompress the file and load it 

On Fri, May 1, 201= 5 at 9:17 AM, Kumar Jayapal <kjayapal17@gmail.com> wrote:
Created table  CREATE TABLE raw (line STRING) PARTITI= ONED BY (FISCAL_YEAR  smallint, FISCAL_PERIOD smallint)
STORED AS TEXTFILE;
and loaded it with data.

LOAD DATA LOCAL INP= ATH '/tmp/weblogs/20090603-access.log.gz' <= /span>INTO TABLE raw;

I have to load it to parqu= e table

when I say select * from raw it shows a= ll null values.

NULL
NULL

NULLNULLNULLNULLNULLNULLNULL
NULL<= /td>NU= LLNULLNULLNULLNULLNULLNULL

NULLNULLNULLNULLNULLNULLNULLNULL

NULL<= /td>NU= LLNULLNULLNULLNULLNULL
Why is not show showing the actual data in file. will it show once I load i= t to parque table?

Please let me know if I am doing anything wrong.=


Thanks
jay 




--
Nitin Pawar


= --Apple-Mail-C1711F17-F7F4-43A8-BBB2-0735A4B8590C--