Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Wed, 23 Jul 2014 16:03:41 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12654837.1372199981226.29686.1406131421291@arcas>
In-Reply-To: <JIRA.12654837.1372199981226@arcas>
References: <JIRA.12654837.1372199981226@arcas>
Subject: [jira] [Commented] (HIVE-4788) RCFile and bzip2 compression not
 working
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HIVE-4788?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D14071=
891#comment-14071891 ]=20

Hive QA commented on HIVE-4788:
-------------------------------


{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12657276/HIVE-4788.1.patch=
.txt

{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 5737 tests exe=
cuted
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_ql_rewrite_gbt=
oidx
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_auth=
orization_fail_8
org.apache.hive.jdbc.TestJdbcDriver2.testParentReferences
org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job=
/PreCommit-HIVE-TRUNK-Build/20/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/j=
ob/PreCommit-HIVE-TRUNK-Build/20/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit=
-HIVE-TRUNK-Build-20/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12657276

> RCFile and bzip2 compression not working
> ----------------------------------------
>
>                 Key: HIVE-4788
>                 URL: https://issues.apache.org/jira/browse/HIVE-4788
>             Project: Hive
>          Issue Type: Bug
>          Components: Compression
>    Affects Versions: 0.10.0
>         Environment: CDH4.2
>            Reporter: Johndee Burks
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-4788.1.patch.txt
>
>
> The issue is that Bzip2 compressed rcfile data is encountering an error w=
hen being queried even the most simple query "select *". The issue is easil=
y reproducible using the following.=20
> Create a table and load the sample data below.=20
> DDL: create table source_data (a string, b string) row format delimited f=
ields terminated by ',';
> Sample data:=20
> apple,sauce=20
> Test:=20
> Do the following and you should receive the error listed below for the rc=
file table with bz2 compression.=20
> create table rc_nobz2 (a string, b string) stored as rcfile;=20
> insert into table rc_nobz2 select * from source_txt;=20
> SET io.seqfile.compression.type=3DBLOCK;=20
> SET hive.exec.compress.output=3Dtrue;=20
> SET mapred.compress.map.output=3Dtrue;=20
> SET mapred.output.compress=3Dtrue;=20
> SET mapred.output.compression.codec=3Dorg.apache.hadoop.io.compress.BZip2=
Codec;=20
> create table rc_bz2 (a string, b string) stored as rcfile;=20
> insert into table rc_bz2 select * from source_txt;=20
> hive> select * from rc_bz2;=20
> Failed with exception java.io.IOException:java.io.IOException: Stream is =
not BZip2 formatted: expected 'h' as first byte but got '=EF=BF=BF'=20
> hive> select * from rc_nobz2;=20
> apple=09sauce


--
This message was sent by Atlassian JIRA
(v6.2#6252)