hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13363) Add hive.metastore.token.signature property to HiveConf
Date Mon, 28 Mar 2016 16:51:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214459#comment-15214459
] 

Hive QA commented on HIVE-13363:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12795494/HIVE-13363.1.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7397/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/7397/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-7397/

Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[WARNING]   - org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim
[WARNING]   - 64 more...
[WARNING] hive-exec-2.1.0-SNAPSHOT.jar, snappy-0.2.jar define 16 overlappping classes: 
[WARNING]   - org.iq80.snappy.SnappyCompressor
[WARNING]   - org.iq80.snappy.SlowMemory
[WARNING]   - org.iq80.snappy.Crc32C
[WARNING]   - org.iq80.snappy.CorruptionException
[WARNING]   - org.iq80.snappy.UnsafeMemory
[WARNING]   - org.iq80.snappy.Memory
[WARNING]   - org.iq80.snappy.Snappy
[WARNING]   - org.iq80.snappy.Main
[WARNING]   - org.iq80.snappy.HadoopSnappyCodec
[WARNING]   - org.iq80.snappy.SnappyDecompressor
[WARNING]   - 6 more...
[WARNING] hive-serde-2.1.0-SNAPSHOT.jar, hive-exec-2.1.0-SNAPSHOT.jar define 588 overlappping
classes: 
[WARNING]   - org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector
[WARNING]   - org.apache.hadoop.hive.serde2.lazy.LazySerDeParameters
[WARNING]   - org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeXception
[WARNING]   - org.apache.hadoop.hive.serde2.proto.test.Complexpb$Complex
[WARNING]   - org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDeStructBase
[WARNING]   - org.apache.hadoop.hive.serde.test.ThriftTestObj$ThriftTestObjTupleSchemeFactory
[WARNING]   - org.apache.hadoop.hive.serde2.thrift.test.Complex$1
[WARNING]   - org.apache.hadoop.hive.serde2.thrift.test.MiniStruct
[WARNING]   - org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaLongObjectInspector
[WARNING]   - org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorConverter$1
[WARNING]   - 578 more...
[WARNING] jackson-mapper-asl-1.9.2.jar, hive-exec-2.1.0-SNAPSHOT.jar define 494 overlappping
classes: 
[WARNING]   - org.codehaus.jackson.map.ser.impl.SerializerCache$TypeKey
[WARNING]   - org.codehaus.jackson.map.DeserializerProvider
[WARNING]   - org.codehaus.jackson.map.deser.std.StdKeyDeserializer$LongKD
[WARNING]   - org.codehaus.jackson.node.ValueNode
[WARNING]   - org.codehaus.jackson.map.ser.std.CollectionSerializer
[WARNING]   - org.codehaus.jackson.map.ser.impl.PropertySerializerMap$Double
[WARNING]   - org.codehaus.jackson.map.deser.FromStringDeserializer
[WARNING]   - org.codehaus.jackson.map.deser.std.StdKeyDeserializer$FloatKD
[WARNING]   - org.codehaus.jackson.map.Deserializers
[WARNING]   - org.codehaus.jackson.map.ser.StdSerializers$SerializableSerializer
[WARNING]   - 484 more...
[WARNING] hadoop-yarn-common-2.6.0.jar, hadoop-yarn-api-2.6.0.jar define 3 overlappping classes:

[WARNING]   - org.apache.hadoop.yarn.factories.package-info
[WARNING]   - org.apache.hadoop.yarn.util.package-info
[WARNING]   - org.apache.hadoop.yarn.factory.providers.package-info
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar, commons-collections-3.2.2.jar
define 10 overlappping classes: 
[WARNING]   - org.apache.commons.collections.FastHashMap$EntrySet
[WARNING]   - org.apache.commons.collections.ArrayStack
[WARNING]   - org.apache.commons.collections.FastHashMap$1
[WARNING]   - org.apache.commons.collections.FastHashMap$KeySet
[WARNING]   - org.apache.commons.collections.FastHashMap$CollectionView
[WARNING]   - org.apache.commons.collections.BufferUnderflowException
[WARNING]   - org.apache.commons.collections.Buffer
[WARNING]   - org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
[WARNING]   - org.apache.commons.collections.FastHashMap$Values
[WARNING]   - org.apache.commons.collections.FastHashMap
[WARNING] hive-shims-0.23-2.1.0-SNAPSHOT.jar, hive-exec-2.1.0-SNAPSHOT.jar define 29 overlappping
classes: 
[WARNING]   - org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsFileStatusWithIdImpl
[WARNING]   - org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim
[WARNING]   - org.apache.hadoop.hive.shims.Jetty23Shims$Server
[WARNING]   - org.apache.hadoop.mapred.WebHCatJTShim23
[WARNING]   - org.apache.hadoop.hive.shims.Hadoop23Shims$MiniTezShim
[WARNING]   - org.apache.hadoop.hive.shims.Jetty23Shims$1
[WARNING]   - org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge23
[WARNING]   - org.apache.hadoop.hive.shims.Jetty23Shims
[WARNING]   - org.apache.hadoop.hive.shims.Hadoop23Shims$MiniSparkShim
[WARNING]   - org.apache.hadoop.hive.shims.ZeroCopyShims
[WARNING]   - 19 more...
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO] Replacing /data/hive-ptest/working/apache-github-source-source/itests/hive-jmh/target/benchmarks.jar
with /data/hive-ptest/working/apache-github-source-source/itests/hive-jmh/target/hive-jmh-2.1.0-SNAPSHOT-shaded.jar
[INFO] 
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-jmh ---
[INFO] Installing /data/hive-ptest/working/apache-github-source-source/itests/hive-jmh/target/hive-jmh-2.1.0-SNAPSHOT.jar
to /data/hive-ptest/working/maven/org/apache/hive/hive-jmh/2.1.0-SNAPSHOT/hive-jmh-2.1.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-github-source-source/itests/hive-jmh/pom.xml
to /data/hive-ptest/working/maven/org/apache/hive/hive-jmh/2.1.0-SNAPSHOT/hive-jmh-2.1.0-SNAPSHOT.pom
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Integration - Unit Tests - Hadoop 2 2.1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-it-unit-hadoop2 ---
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target
[INFO] Deleting /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2
(includes = [datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-no-snapshots) @ hive-it-unit-hadoop2
---
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (download-spark) @ hive-it-unit-hadoop2 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-it-unit-hadoop2 ---
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-it-unit-hadoop2
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-it-unit-hadoop2 ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-it-unit-hadoop2 ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-it-unit-hadoop2
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-it-unit-hadoop2 ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/tmp
    [mkdir] Created dir: /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/warehouse
    [mkdir] Created dir: /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/tmp/conf
     [copy] Copying 16 files to /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/tmp/conf
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-metastore-scripts) @ hive-it-unit-hadoop2 ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/tmp/scripts/metastore
     [copy] Copying 309 files to /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/tmp/scripts/metastore
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-it-unit-hadoop2
---
[INFO] Compiling 5 source files to /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/target/test-classes
[INFO] -------------------------------------------------------------
[WARNING] COMPILATION WARNING : 
[INFO] -------------------------------------------------------------
[WARNING] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/ql/security/TestExtendedAcls.java:
Some input files use or override a deprecated API.
[WARNING] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/ql/security/TestExtendedAcls.java:
Recompile with -Xlint:deprecation for details.
[WARNING] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/ql/security/TestPasswordWithCredentialProvider.java:
/data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/ql/security/TestPasswordWithCredentialProvider.java
uses unchecked or unsafe operations.
[WARNING] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/ql/security/TestPasswordWithCredentialProvider.java:
Recompile with -Xlint:unchecked for details.
[INFO] 4 warnings 
[INFO] -------------------------------------------------------------
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR : 
[INFO] -------------------------------------------------------------
[ERROR] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/thrift/TestHadoopAuthBridge23.java:[355,11]
no suitable method found for set(org.apache.hadoop.hive.conf.HiveConf.ConfVars,java.lang.String)
    method org.apache.hadoop.conf.Configuration.set(java.lang.String,java.lang.String,java.lang.String)
is not applicable
      (actual and formal argument lists differ in length)
    method org.apache.hadoop.conf.Configuration.set(java.lang.String,java.lang.String) is
not applicable
      (actual argument org.apache.hadoop.hive.conf.HiveConf.ConfVars cannot be converted to
java.lang.String by method invocation conversion)
[INFO] 1 error
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Hive Integration - Parent ......................... SUCCESS [9.282s]
[INFO] Hive Integration - Custom Serde ................... SUCCESS [15.102s]
[INFO] Hive Integration - Custom udfs .................... SUCCESS [3.176s]
[INFO] Hive Integration - Custom UDFs - udf-classloader-util  SUCCESS [4.987s]
[INFO] Hive Integration - Custom UDFs - udf-classloader-udf1  SUCCESS [5.220s]
[INFO] Hive Integration - Custom UDFs - udf-classloader-udf2  SUCCESS [4.186s]
[INFO] Hive Integration - HCatalog Unit Tests ............ SUCCESS [15.882s]
[INFO] Hive Integration - Testing Utilities .............. SUCCESS [19.265s]
[INFO] Hive Integration - Unit Tests ..................... SUCCESS [30.206s]
[INFO] Hive Integration - Test Serde ..................... SUCCESS [1.873s]
[INFO] Hive Integration - QFile Tests .................... SUCCESS [15.856s]
[INFO] Hive Integration - QFile Accumulo Tests ........... SUCCESS [10.959s]
[INFO] JMH benchmark: Hive ............................... SUCCESS [39.133s]
[INFO] Hive Integration - Unit Tests - Hadoop 2 .......... FAILURE [4.464s]
[INFO] Hive Integration - Unit Tests with miniKdc ........ SKIPPED
[INFO] Hive Integration - QFile Spark Tests .............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:05.669s
[INFO] Finished at: Mon Mar 28 12:50:48 EDT 2016
[INFO] Final Memory: 176M/556M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hadoop-2" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project hive-it-unit-hadoop2: Compilation failure
[ERROR] /data/hive-ptest/working/apache-github-source-source/itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/thrift/TestHadoopAuthBridge23.java:[355,11]
no suitable method found for set(org.apache.hadoop.hive.conf.HiveConf.ConfVars,java.lang.String)
[ERROR] method org.apache.hadoop.conf.Configuration.set(java.lang.String,java.lang.String,java.lang.String)
is not applicable
[ERROR] (actual and formal argument lists differ in length)
[ERROR] method org.apache.hadoop.conf.Configuration.set(java.lang.String,java.lang.String)
is not applicable
[ERROR] (actual argument org.apache.hadoop.hive.conf.HiveConf.ConfVars cannot be converted
to java.lang.String by method invocation conversion)
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hive-it-unit-hadoop2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12795494 - PreCommit-HIVE-TRUNK-Build

> Add hive.metastore.token.signature property to HiveConf
> -------------------------------------------------------
>
>                 Key: HIVE-13363
>                 URL: https://issues.apache.org/jira/browse/HIVE-13363
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Anthony Hsu
>            Assignee: Anthony Hsu
>         Attachments: HIVE-13363.1.patch
>
>
> I noticed that the {{hive.metastore.token.signature}} property is not defined in HiveConf.java,
but hardcoded everywhere it's used in the Hive codebase.
> [HIVE-2963] fixes this but was never committed due to being resolved as a duplicate ticket.
> We should add {{hive.metastore.token.signature}} to HiveConf.java to centralize its definition
and make the property more discoverable (it's useful to set it when talking to multiple metastores).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message