Return-Path: 
 <user-return-8861-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id D2D92103E5
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Thu, 20 Jun 2013 05:18:52 +0000 (UTC)
Received: (qmail 20929 invoked by uid 500); 20 Jun 2013 05:18:47 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 20488 invoked by uid 500); 20 Jun 2013 05:18:46 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 20469 invoked by uid 99); 20 Jun 2013 05:18:45 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jun 2013 05:18:45 +0000
X-ASF-Spam-Status: No, hits=-0.5 required=5.0
	tests=ASF_LIST_OPS,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of samir.helpdoc@gmail.com
 designates 209.85.220.173 as permitted sender)
Received: from [209.85.220.173] (HELO mail-vc0-f173.google.com)
 (209.85.220.173)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jun 2013 05:18:38 +0000
Received: by mail-vc0-f173.google.com with SMTP id ht10so4455019vcb.32
        for <multiple recipients>; Wed, 19 Jun 2013 22:18:17 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=6paQ6A3zfaEmSepnj9BOr/b6+7u6U5Cv+F0cdhOGw/0=;
        b=pH9NEZs1xBJBw9neM3DWQ9DABZjGyItMUzvePLcT43e2QHN/3JRZkoX4ttVxOFxIlh
         XZrIneAtt8uFGuN7fV+oOVpJEPQiu8UJZlpIp/O4jR3P8ojnu7F/aZidCltZcjHEjU27
         bQ0RImQO7Ttn61deDJnEkK5nhyHkh63Tpm6L34nl6TLz2mBQZfyhPVCyDUO2mkY+XgJ1
         0grnSfoJ0WJY+2Ptn8Gxy/M6YZn+AnZKKzdy1I9jQKN8ITCuNGy9VBn3RNVKBYAO5fqC
         LVuTCZyUJnvQtg6EivH00wAuCTPVIzogRJD7/ZouHUqYAYORRMurOmlYJ4PFWPZBNFeb
         oBxA==
MIME-Version: 1.0
X-Received: by 10.58.171.167 with SMTP id av7mr2186223vec.15.1371705497858;
 Wed, 19 Jun 2013 22:18:17 -0700 (PDT)
Received: by 10.59.10.230 with HTTP; Wed, 19 Jun 2013 22:18:17 -0700 (PDT)
Date: Thu, 20 Jun 2013 10:48:17 +0530
Message-ID: 
 <CAG4QEv5ksOdADqp6ZaJ9_X+Osz-MgTvUaOAmhaf1DgFaTZkc=A@mail.gmail.com>
Subject: Error While Processing SequeceFile with Lzo Compressed in hive
 External table (CDH4.3)
From: samir das mohapatra <samir.helpdoc@gmail.com>
To: user@hadoop.apache.org, user-help@hadoop.apache.org,
 cdh-user@cloudera.com,
	cdh-user@cloudera.org
Content-Type: multipart/alternative; boundary=047d7b677a18efbab504df8f1285
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b677a18efbab504df8f1285
Content-Type: text/plain; charset=ISO-8859-1

Dear All,

 Any One would have face this type of Issue ?

  I am getting Some error while processing Sequecen file with LZO compresss
in hive query  In CDH4.3.x Distribution.

Error Logs:

SET hive.exec.compress.output=true;

SET mapred.output.compression.codec=com.hadoop.compression.lzo.LzopCodec;



-rw-r--r--   3 myuser supergroup      25172 2013-06-19 21:25
/user/myDir/000000_0  -- Lzo Compressed sequence file



-rw-r--r--   3 myuser   supergroup      71007 2013-06-19 21:42
/user/myDir/000000_0   -- Normal sequence file



1.       Now the problem that if I create an External table on top of the
directory to read the data it gives me an error : *Failed with exception
java.io.IOException:java.io.EOFException: Premature EOF from inputStream*

*
*

*Table Creation:*

*
*

*
*

CREATE EXTERNAL TABLE IF NOT EXISTS MyTable

(

userip  string

usertid string

)

ROW FORMAT DELIMITED

   FIELDS TERMINATED BY '\001'  ESCAPED BY '\020'

   COLLECTION ITEMS TERMINATED BY '\002'

   MAP KEYS TERMINATED BY '\003'

   LINES TERMINATED BY '\012'

STORED AS SEQUENCEFILE

LOCATION '/path/to/file';


After that while querying to the table getting error:


*Failed with exception java.io.IOException:java.io.EOFException: Premature
EOF from inputStream*
*
*
*Why it is like that?*
*
*
*Regards,*
*samir*

*
*

*
*

*
*

*T*

*
*

*
*

*
*

--047d7b677a18efbab504df8f1285
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Dear All,<div style><br></div><div style>=A0Any One would =
have face this type of Issue ?</div><div style><br></div><div style>=A0 I a=
m getting Some error while processing Sequecen file with LZO compresss in h=
ive query =A0In CDH4.3.x Distribution.</div>
<div style><br></div><div style>Error Logs:</div><div style><br></div><div =
style><p class=3D""><span style=3D"font-size:10pt;font-family:&#39;Courier =
New&#39;">SET
hive.exec.compress.output=3Dtrue;</span></p>

<pre>SET mapred.output.compression.codec=3Dcom.hadoop.compression.lzo.LzopC=
odec;</pre><pre>=A0</pre><pre>-rw-r--r--=A0=A0 3 myuser supergroup=A0=A0=A0=
=A0=A0 <span style=3D"background-color:yellow">25172</span> 2013-06-19 21:2=
5 /user/<span style=3D"font-family:arial">myDir</span><span style=3D"font-f=
amily:arial">/000000_0=A0 -- Lzo Compressed sequence file</span><br>
</pre><pre>=A0</pre><pre>-rw-r--r--=A0=A0 3 <span style=3D"font-family:aria=
l">myuser   </span><span style=3D"font-family:arial">supergroup=A0=A0=A0=A0=
=A0 </span><span style=3D"font-family:arial;background-color:yellow">71007<=
/span><span style=3D"font-family:arial"> 2013-06-19 21:42 /user/myDir/00000=
0_0=A0=A0 -- Normal sequence file</span><br>
</pre><pre>=A0</pre>

<p class=3D"" style>1.<span style=3D"font-size:7pt;font-family:&#39;Times N=
ew Roman&#39;">=A0=A0=A0=A0=A0=A0 </span>Now
the problem that if I create an External table on top of the directory to r=
ead
the data it gives me an error : <b><span style=3D"color:red">Failed with
exception java.io.IOException:java.io.EOFException: Premature EOF from
inputStream</span></b></p><p class=3D"" style><b><span style=3D"color:red">=
<br></span></b></p><p class=3D"" style><b><span style=3D"color:red">Table C=
reation:</span></b></p><p class=3D"" style><b><span style=3D"color:red"><br=
></span></b></p>
<p class=3D"" style><b><span style=3D"color:red"><br></span></b></p><p clas=
s=3D"">CREATE EXTERNAL TABLE IF NOT EXISTS MyTable</p><p class=3D"">(</p><p=
 class=3D""></p><p class=3D"">userip=A0 string<br></p><p class=3D""></p><p =
class=3D"">usertid string </p>
<p class=3D"">)</p><p class=3D"">ROW FORMAT DELIMITED</p><p class=3D"">=A0=
=A0 FIELDS TERMINATED BY &#39;\001&#39;=A0 ESCAPED BY
&#39;\020&#39;</p><p class=3D"">=A0=A0 COLLECTION ITEMS TERMINATED BY &#39;=
\002&#39;</p><p class=3D"">=A0=A0 MAP KEYS TERMINATED BY &#39;\003&#39;</p>=
<p class=3D"">=A0=A0 LINES TERMINATED BY &#39;\012&#39;</p><p class=3D"">ST=
ORED AS SEQUENCEFILE</p>
<p class=3D"" style>































































































</p><p class=3D"">LOCATION &#39;/path/to/file&#39;;</p><p class=3D""><br></=
p><p class=3D"" style>After that while querying to the table getting error:=
</p><p class=3D"" style><br></p><p class=3D"" style><b><span style=3D"color=
:red">Failed with exception java.io.IOException:java.io.EOFException: Prema=
ture EOF from inputStream</span></b></p>
<div><b><span style=3D"color:red"><br></span></b></div><div style><b><span =
style=3D"color:red">Why it is like that?</span></b></div><div style><b><spa=
n style=3D"color:red"><br></span></b></div><div style><b><span style=3D"col=
or:red">Regards,</span></b></div>
<div style><b><span style=3D"color:red">samir</span></b></div><p class=3D""=
 style><b><span style=3D"color:red"><br></span></b></p><p class=3D"" style>=
<b><span style=3D"color:red"><br></span></b></p><p class=3D"" style><b><spa=
n style=3D"color:red"><br>
</span></b></p><p class=3D"" style><font color=3D"#ff0000"><b>T</b></font><=
/p><p class=3D"" style><b><span style=3D"color:red"><br></span></b></p><p c=
lass=3D"" style><b><span style=3D"color:red"><br></span></b></p><p class=3D=
"" style><b><span style=3D"color:red"><br>
</span></b></p>

<p class=3D"">=A0</p></div></div>

--047d7b677a18efbab504df8f1285--