hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhenxiao Luo (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-2788) When integrating into MapReduce2, Hive is unable to handle corrupt rcfile archive
Date Wed, 08 Feb 2012 20:06:59 GMT

     [ https://issues.apache.org/jira/browse/HIVE-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhenxiao Luo updated HIVE-2788:
-------------------------------

    Description: 
archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc:

[junit] Running org.apache.hadoop.hive.cli.TestCliDriver
[junit] Begin query: archive_corrupt.q
[junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
[junit] Exception: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
[for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing
this line:
[for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing
this line:
[for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:

PREHOOK: query: drop table tstsrcpart
PREHOOK: type: DROPTABLE
POSTHOOK: query: drop table tstsrcpart
POSTHOOK: type: DROPTABLE
PREHOOK: query: create table tstsrcpart like srcpart
PREHOOK: type: CREATETABLE
POSTHOOK: query: create table tstsrcpart like srcpart
POSTHOOK: type: CREATETABLE
POSTHOOK: Output: default@tstsrcpart
PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into table
tstsrcpart partition (ds='2008-04-08', hr='11')
PREHOOK: type: LOAD
PREHOOK: Output: default@tstsrcpart
Failed with exception Wrong file format. Please check the file's format.
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask


When running the following:
load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart
partition (ds='2008-04-08', hr='11')

Get exception:
Failed with exception Wrong file format. Please check the file's format.
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask



  was:
archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc:

[junit] Running org.apache.hadoop.hive.cli.TestCliDriver
[junit] Begin query: archive_corrupt.q
[junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
[junit] Exception: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
[for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing
this line:
[for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing
this line:
[for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:

PREHOOK: query: drop table tstsrcpart
PREHOOK: type: DROPTABLE
POSTHOOK: query: drop table tstsrcpart
POSTHOOK: type: DROPTABLE
PREHOOK: query: create table tstsrcpart like srcpart
PREHOOK: type: CREATETABLE
POSTHOOK: query: create table tstsrcpart like srcpart
POSTHOOK: type: CREATETABLE
POSTHOOK: Output: default@tstsrcpart
PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into table
tstsrcpart partition (ds='2008-04-08', hr='11')
PREHOOK: type: LOAD
PREHOOK: Output: default@tstsrcpart
Failed with exception Wrong file format. Please check the file's format.
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

        Summary: When integrating into MapReduce2, Hive is unable to handle corrupt rcfile
archive  (was: When integrating into MapReduce2, get wrong file exception in loading archive_corrupt.rc)
    
> When integrating into MapReduce2, Hive is unable to handle corrupt rcfile archive
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-2788
>                 URL: https://issues.apache.org/jira/browse/HIVE-2788
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Zhenxiao Luo
>            Assignee: Zhenxiao Luo
>
> archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc:
> [junit] Running org.apache.hadoop.hive.cli.TestCliDriver
> [junit] Begin query: archive_corrupt.q
> [junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
> [junit] Exception: Client Execution failed with error code = 9
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
> [junit] junit.framework.AssertionFailedError: Client Execution failed with error code
= 9
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
> [junit] at junit.framework.Assert.fail(Assert.java:50)
> [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at java.lang.reflect.Method.invoke(Method.java:616)
> [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
> [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
> [junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
> [junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
> [junit] at junit.framework.TestResult.run(TestResult.java:113)
> [junit] at junit.framework.TestCase.run(TestCase.java:124)
> [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
> [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.)
> [junit] Cleaning up TestCliDriver
> [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
> [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
> [for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing
this line:
> [for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing
this line:
> [for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!
> And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:
> PREHOOK: query: drop table tstsrcpart
> PREHOOK: type: DROPTABLE
> POSTHOOK: query: drop table tstsrcpart
> POSTHOOK: type: DROPTABLE
> PREHOOK: query: create table tstsrcpart like srcpart
> PREHOOK: type: CREATETABLE
> POSTHOOK: query: create table tstsrcpart like srcpart
> POSTHOOK: type: CREATETABLE
> POSTHOOK: Output: default@tstsrcpart
> PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into
table tstsrcpart partition (ds='2008-04-08', hr='11')
> PREHOOK: type: LOAD
> PREHOOK: Output: default@tstsrcpart
> Failed with exception Wrong file format. Please check the file's format.
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
> When running the following:
> load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart
partition (ds='2008-04-08', hr='11')
> Get exception:
> Failed with exception Wrong file format. Please check the file's format.
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message