hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "alton.jung (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8101) Hive on spark Issue during compiling hive source
Date Mon, 15 Sep 2014 08:44:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

alton.jung updated HIVE-8101:
-----------------------------
    Description: 
1) downloaded hive on spark source from https://github.com/apache/hive/tree/spark
2) changed guava library to 14 of hadoop since there was common error
3) compiled with "mvn clean install  -Dhadoop-23.version=2.4.0  -Phadoop-2,dist"
4) i got the below error..
5) So i edit the pom.xml to erace the relevant test jar (i am not sure it is the right process
to avoid below error)...


[Error Logs]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.892 sec - in org.apache.hadoop.hive.metastore.TestMetastoreExpr

Results :

Failed tests: 
  TestOrcSerDeStats.testStringAndBinaryStatistics:211 expected:<273> but was:<165>
  TestOrcSerDeStats.testOrcSerDeStatsList:309 expected:<430000000> but was:<250000000>
  TestOrcSerDeStats.testOrcSerDeStatsMap:341 expected:<950000> but was:<590000>
  TestOrcSerDeStats.testOrcSerDeStatsSimpleWithNulls:373 expected:<44500> but was:<26500>
  TestOrcSerDeStats.testOrcSerDeStatsComplex:416 expected:<1740> but was:<1104>
  TestOrcSerDeStats.testOrcSerDeStatsComplexOldFormat:510 expected:<1740> but was:<1104>

Tests in error: 
  TestOrcSerDeStats.testSerdeStatsOldFormat »  Unexpected exception, expected<ja...

Tests run: 2282, Failures: 6, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Hive .............................................. SUCCESS [32.298s]
[INFO] Hive Shims Common ................................. SUCCESS [12.751s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [3.378s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [2.836s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [2.647s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [4.236s]
[INFO] Hive Shims ........................................ SUCCESS [0.815s]
[INFO] Hive Common ....................................... SUCCESS [53.406s]
[INFO] Hive Serde ........................................ SUCCESS [1:04.661s]
[INFO] Hive Metastore .................................... SUCCESS [1:50.439s]
[INFO] Hive Ant Utilities ................................ SUCCESS [0.803s]
[INFO] Hive Query Language ............................... FAILURE [1:14:38.323s]
[INFO] Hive Service ...................................... SKIPPED
[INFO] Hive Accumulo Handler ............................. SKIPPED
[INFO] Hive JDBC ......................................... SKIPPED
[INFO] Hive Beeline ...................................... SKIPPED
[INFO] Hive CLI .......................................... SKIPPED
[INFO] Hive Contrib ...................................... SKIPPED
[INFO] Hive HBase Handler ................................ SKIPPED
[INFO] Hive HCatalog ..................................... SKIPPED
[INFO] Hive HCatalog Core ................................ SKIPPED
[INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
[INFO] Hive HCatalog Server Extensions ................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
[INFO] Hive HCatalog Webhcat ............................. SKIPPED
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:19:28.909s
[INFO] Finished at: Mon Sep 15 01:33:10 PDT 2014
[INFO] Final Memory: 49M/469M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
on project hive-exec: There are test failures.
[ERROR] 
[ERROR] Please refer to /home/secuser/project/hive-spark/ql/target/surefire-reports for the
individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hive-exec


  was:
1) downloaded hive on spark source from https://github.com/apache/hive/tree/spark
2) changed guava library to 14 of hadoop since there was common error
3) compiled with "mvn clean install -Dmaven.test.skip=true -Dhadoop-23.version=2.4.0  -Phadoop-2,dist"
4) i got the below error..
5) So i edit the pom.xml to erace the relevant test jar (i am not sure it is the right process
to avoid below error)...



[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Hive .............................................. SUCCESS [7.288s]
[INFO] Hive Shims Common ................................. SUCCESS [3.767s]
[INFO] Hive Shims 0.20 ................................... SUCCESS [0.887s]
[INFO] Hive Shims Secure Common .......................... SUCCESS [1.146s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [0.848s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [2.790s]
[INFO] Hive Shims ........................................ SUCCESS [0.311s]
[INFO] Hive Common ....................................... SUCCESS [3.598s]
[INFO] Hive Serde ........................................ SUCCESS [2.507s]
[INFO] Hive Metastore .................................... SUCCESS [8.096s]
[INFO] Hive Ant Utilities ................................ SUCCESS [0.673s]
[INFO] Hive Query Language ............................... SUCCESS [38.493s]
[INFO] Hive Service ...................................... SUCCESS [26.307s]
[INFO] Hive Accumulo Handler ............................. SUCCESS [25.175s]
[INFO] Hive JDBC ......................................... SUCCESS [32.376s]
[INFO] Hive Beeline ...................................... FAILURE [3.198s]
[INFO] Hive CLI .......................................... SKIPPED
[INFO] Hive Contrib ...................................... SKIPPED
[INFO] Hive HBase Handler ................................ SKIPPED
[INFO] Hive HCatalog ..................................... SKIPPED
[INFO] Hive HCatalog Core ................................ SKIPPED
[INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
[INFO] Hive HCatalog Server Extensions ................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
[INFO] Hive HCatalog Webhcat ............................. SKIPPED
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:39.598s
[INFO] Finished at: Mon Sep 15 16:08:14 KST 2014
[INFO] Final Memory: 94M/388M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hive-beeline: Could not resolve dependencies for
project org.apache.hive:hive-beeline:jar:0.14.0-SNAPSHOT: Failure to find org.apache.hive:hive-exec:jar:tests:0.14.0-SNAPSHOT
in http://ec2-50-18-79-139.us-west-1.compute.amazonaws.com/data/spark_2.10-1.1-SNAPSHOT/ was
cached in the local repository, resolution will not be reattempted until the update interval
of spark-snapshot has elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hive-beeline

    Environment: 
1) downloaded hive on spark source from https://github.com/apache/hive/tree
2) mvn clean install -Dhadoop-23.version=2.4.0  -Phadoop-2,dist

  was:
1) downloaded hive on spark source from https://github.com/apache/hive/tree
2) mvn clean install -Dmaven.test.skip=true -Dhadoop-23.version=2.4.0  -Phadoop-2,dist


> Hive on spark Issue during compiling hive source
> ------------------------------------------------
>
>                 Key: HIVE-8101
>                 URL: https://issues.apache.org/jira/browse/HIVE-8101
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2, Spark
>    Affects Versions: 0.14.0, spark-branch
>         Environment: 1) downloaded hive on spark source from https://github.com/apache/hive/tree
> 2) mvn clean install -Dhadoop-23.version=2.4.0  -Phadoop-2,dist
>            Reporter: alton.jung
>             Fix For: 0.14.0, spark-branch
>
>
> 1) downloaded hive on spark source from https://github.com/apache/hive/tree/spark
> 2) changed guava library to 14 of hadoop since there was common error
> 3) compiled with "mvn clean install  -Dhadoop-23.version=2.4.0  -Phadoop-2,dist"
> 4) i got the below error..
> 5) So i edit the pom.xml to erace the relevant test jar (i am not sure it is the right
process to avoid below error)...
> [Error Logs]
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.892 sec - in org.apache.hadoop.hive.metastore.TestMetastoreExpr
> Results :
> Failed tests: 
>   TestOrcSerDeStats.testStringAndBinaryStatistics:211 expected:<273> but was:<165>
>   TestOrcSerDeStats.testOrcSerDeStatsList:309 expected:<430000000> but was:<250000000>
>   TestOrcSerDeStats.testOrcSerDeStatsMap:341 expected:<950000> but was:<590000>
>   TestOrcSerDeStats.testOrcSerDeStatsSimpleWithNulls:373 expected:<44500> but was:<26500>
>   TestOrcSerDeStats.testOrcSerDeStatsComplex:416 expected:<1740> but was:<1104>
>   TestOrcSerDeStats.testOrcSerDeStatsComplexOldFormat:510 expected:<1740> but was:<1104>
> Tests in error: 
>   TestOrcSerDeStats.testSerdeStatsOldFormat »  Unexpected exception, expected<ja...
> Tests run: 2282, Failures: 6, Errors: 1, Skipped: 0
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Hive .............................................. SUCCESS [32.298s]
> [INFO] Hive Shims Common ................................. SUCCESS [12.751s]
> [INFO] Hive Shims 0.20 ................................... SUCCESS [3.378s]
> [INFO] Hive Shims Secure Common .......................... SUCCESS [2.836s]
> [INFO] Hive Shims 0.20S .................................. SUCCESS [2.647s]
> [INFO] Hive Shims 0.23 ................................... SUCCESS [4.236s]
> [INFO] Hive Shims ........................................ SUCCESS [0.815s]
> [INFO] Hive Common ....................................... SUCCESS [53.406s]
> [INFO] Hive Serde ........................................ SUCCESS [1:04.661s]
> [INFO] Hive Metastore .................................... SUCCESS [1:50.439s]
> [INFO] Hive Ant Utilities ................................ SUCCESS [0.803s]
> [INFO] Hive Query Language ............................... FAILURE [1:14:38.323s]
> [INFO] Hive Service ...................................... SKIPPED
> [INFO] Hive Accumulo Handler ............................. SKIPPED
> [INFO] Hive JDBC ......................................... SKIPPED
> [INFO] Hive Beeline ...................................... SKIPPED
> [INFO] Hive CLI .......................................... SKIPPED
> [INFO] Hive Contrib ...................................... SKIPPED
> [INFO] Hive HBase Handler ................................ SKIPPED
> [INFO] Hive HCatalog ..................................... SKIPPED
> [INFO] Hive HCatalog Core ................................ SKIPPED
> [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
> [INFO] Hive HCatalog Server Extensions ................... SKIPPED
> [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
> [INFO] Hive HCatalog Webhcat ............................. SKIPPED
> [INFO] Hive HCatalog Streaming ........................... SKIPPED
> [INFO] Hive HWI .......................................... SKIPPED
> [INFO] Hive ODBC ......................................... SKIPPED
> [INFO] Hive Shims Aggregator ............................. SKIPPED
> [INFO] Hive TestUtils .................................... SKIPPED
> [INFO] Hive Packaging .................................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:19:28.909s
> [INFO] Finished at: Mon Sep 15 01:33:10 PDT 2014
> [INFO] Final Memory: 49M/469M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test
(default-test) on project hive-exec: There are test failures.
> [ERROR] 
> [ERROR] Please refer to /home/secuser/project/hive-spark/ql/target/surefire-reports for
the individual test results.
> [ERROR] -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the
following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :hive-exec



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message