hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]
Date Wed, 13 Aug 2014 03:01:17 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095082#comment-14095082
] 

Hive QA commented on HIVE-7643:
-------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12661381/HIVE-7643.1-spark.patch

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/36/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/36/console
Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-36/

Messages:
{noformat}
**** This message was trimmed, see log for full details ****
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/itests/hive-unit/target/hive-it-unit-0.14.0-SNAPSHOT-tests.jar
to /data/hive-ptest/working/maven/org/apache/hive/hive-it-unit/0.14.0-SNAPSHOT/hive-it-unit-0.14.0-SNAPSHOT-tests.jar
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Integration - Test Serde 0.14.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-it-test-serde ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde (includes
= [datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-it-test-serde ---
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-it-test-serde ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-it-test-serde ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-it-test-serde ---
[INFO] Compiling 1 source file to /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/classes
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/src/main/java/org/apache/hadoop/hive/serde2/TestSerDe.java:
/data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/src/main/java/org/apache/hadoop/hive/serde2/TestSerDe.java
uses or overrides a deprecated API.
[WARNING] /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/src/main/java/org/apache/hadoop/hive/serde2/TestSerDe.java:
Recompile with -Xlint:deprecation for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-it-test-serde
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-it-test-serde ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/tmp
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/warehouse
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/tmp/conf
     [copy] Copying 8 files to /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/tmp/conf
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-it-test-serde
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-it-test-serde ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-it-test-serde ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/hive-it-test-serde-0.14.0-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-it-test-serde
---
[INFO] 
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-it-test-serde ---
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/target/hive-it-test-serde-0.14.0-SNAPSHOT.jar
to /data/hive-ptest/working/maven/org/apache/hive/hive-it-test-serde/0.14.0-SNAPSHOT/hive-it-test-serde-0.14.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/itests/test-serde/pom.xml
to /data/hive-ptest/working/maven/org/apache/hive/hive-it-test-serde/0.14.0-SNAPSHOT/hive-it-test-serde-0.14.0-SNAPSHOT.pom
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Integration - QFile Tests 0.14.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-it-qfile ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-spark-source/itests/qtest (includes =
[datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ hive-it-qfile
---
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-it-qfile ---
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-it-qfile ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/src/main/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-it-qfile ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-it-qfile ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (generate-tests-sources) @ hive-it-qfile ---
[INFO] Executing tasks

main:
     [echo] /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/test-classes:/data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/classes:/data/hive-ptest/working/maven/org/apache/hive/hive-ant/0.14.0-SNAPSHOT/hive-ant-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/data/hive-ptest/working/maven/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/data/hive-ptest/working/maven/org/apache/ant/ant/1.9.1/ant-1.9.1.jar:/data/hive-ptest/working/maven/org/apache/ant/ant-launcher/1.9.1/ant-launcher-1.9.1.jar:/data/hive-ptest/working/maven/org/apache/velocity/velocity/1.5/velocity-1.5.jar:/data/hive-ptest/working/maven/oro/oro/2.0.8/oro-2.0.8.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-common/0.14.0-SNAPSHOT/hive-common-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-shims/0.14.0-SNAPSHOT/hive-shims-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-common/0.14.0-SNAPSHOT/hive-shims-common-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-0.20/0.14.0-SNAPSHOT/hive-shims-0.20-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-common-secure/0.14.0-SNAPSHOT/hive-shims-common-secure-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-0.20S/0.14.0-SNAPSHOT/hive-shims-0.20S-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/shims/hive-shims-0.23/0.14.0-SNAPSHOT/hive-shims-0.23-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/data/hive-ptest/working/maven/log4j/log4j/1.2.16/log4j-1.2.16.jar:/data/hive-ptest/working/maven/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/data/hive-ptest/working/maven/org/tukaani/xz/1.0/xz-1.0.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-contrib/0.14.0-SNAPSHOT/hive-contrib-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-metastore/0.14.0-SNAPSHOT/hive-metastore-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar:/data/hive-ptest/working/maven/org/apache/derby/derby/10.10.1.1/derby-10.10.1.1.jar:/data/hive-ptest/working/maven/org/datanucleus/datanucleus-api-jdo/3.2.6/datanucleus-api-jdo-3.2.6.jar:/data/hive-ptest/working/maven/org/datanucleus/datanucleus-core/3.2.10/datanucleus-core-3.2.10.jar:/data/hive-ptest/working/maven/org/datanucleus/datanucleus-rdbms/3.2.9/datanucleus-rdbms-3.2.9.jar:/data/hive-ptest/working/maven/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar:/data/hive-ptest/working/maven/commons-dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar:/data/hive-ptest/working/maven/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar:/data/hive-ptest/working/maven/javax/transaction/jta/1.1/jta-1.1.jar:/data/hive-ptest/working/maven/org/antlr/antlr-runtime/3.4/antlr-runtime-3.4.jar:/data/hive-ptest/working/maven/org/antlr/stringtemplate/3.2.1/stringtemplate-3.2.1.jar:/data/hive-ptest/working/maven/antlr/antlr/2.7.7/antlr-2.7.7.jar:/data/hive-ptest/working/maven/org/apache/thrift/libfb303/0.9.0/libfb303-0.9.0.jar:/data/hive-ptest/working/maven/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar:/data/hive-ptest/working/maven/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/data/hive-ptest/working/maven/org/apache/httpcomponents/httpcore/4.2.5/httpcore-4.2.5.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-metastore/0.14.0-SNAPSHOT/hive-metastore-0.14.0-SNAPSHOT-tests.jar:/data/hive-ptest/working/apache-svn-spark-source/itests/custom-serde/target/hive-it-custom-serde-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/apache-svn-spark-source/itests/util/target/hive-it-util-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-cli/0.14.0-SNAPSHOT/hive-cli-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-service/0.14.0-SNAPSHOT/hive-service-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/net/sf/jpam/jpam/1.1/jpam-1.1.jar:/data/hive-ptest/working/maven/org/eclipse/jetty/aggregate/jetty-all/7.6.0.v20120127/jetty-all-7.6.0.v20120127.jar:/data/hive-ptest/working/maven/org/apache/geronimo/specs/geronimo-jta_1.1_spec/1.1.1/geronimo-jta_1.1_spec-1.1.1.jar:/data/hive-ptest/working/maven/javax/mail/mail/1.4.1/mail-1.4.1.jar:/data/hive-ptest/working/maven/org/apache/geronimo/specs/geronimo-jaspic_1.0_spec/1.0/geronimo-jaspic_1.0_spec-1.0.jar:/data/hive-ptest/working/maven/org/apache/geronimo/specs/geronimo-annotation_1.0_spec/1.1.1/geronimo-annotation_1.0_spec-1.1.1.jar:/data/hive-ptest/working/maven/asm/asm-commons/3.1/asm-commons-3.1.jar:/data/hive-ptest/working/maven/asm/asm-tree/3.1/asm-tree-3.1.jar:/data/hive-ptest/working/maven/jline/jline/0.9.94/jline-0.9.94.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-hbase-handler/0.14.0-SNAPSHOT/hive-hbase-handler-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-hbase-handler/0.14.0-SNAPSHOT/hive-hbase-handler-0.14.0-SNAPSHOT-tests.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-exec/0.14.0-SNAPSHOT/hive-exec-0.14.0-SNAPSHOT-tests.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-serde/0.14.0-SNAPSHOT/hive-serde-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/org/apache/avro/avro/1.7.5/avro-1.7.5.jar:/data/hive-ptest/working/maven/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/data/hive-ptest/working/maven/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar:/data/hive-ptest/working/maven/org/apache/hive/hive-exec/0.14.0-SNAPSHOT/hive-exec-0.14.0-SNAPSHOT.jar:/data/hive-ptest/working/maven/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar:/data/hive-ptest/working/maven/commons-io/commons-io/2.4/commons-io-2.4.jar:/data/hive-ptest/working/maven/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/data/hive-ptest/working/maven/org/antlr/ST4/4.0.4/ST4-4.0.4.jar:/data/hive-ptest/working/maven/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/data/hive-ptest/working/maven/org/codehaus/groovy/groovy-all/2.1.6/groovy-all-2.1.6.jar:/data/hive-ptest/working/maven/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/data/hive-ptest/working/maven/junit/junit/4.10/junit-4.10.jar:/data/hive-ptest/working/maven/org/hamcrest/hamcrest-core/1.1/hamcrest-core-1.1.jar:/data/hive-ptest/working/maven/com/sun/jersey/jersey-servlet/1.14/jersey-servlet-1.14.jar:/data/hive-ptest/working/maven/com/sun/jersey/jersey-server/1.14/jersey-server-1.14.jar:/data/hive-ptest/working/maven/asm/asm/3.1/asm-3.1.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-archives/2.4.0/hadoop-archives-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-common/2.4.0/hadoop-common-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-annotations/2.4.0/hadoop-annotations-2.4.0.jar:/usr/java/jdk1.7.0_45-cloudera/lib/tools.jar:/data/hive-ptest/working/maven/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/data/hive-ptest/working/maven/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/data/hive-ptest/working/maven/commons-net/commons-net/3.1/commons-net-3.1.jar:/data/hive-ptest/working/maven/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/data/hive-ptest/working/maven/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/data/hive-ptest/working/maven/com/sun/jersey/jersey-core/1.14/jersey-core-1.14.jar:/data/hive-ptest/working/maven/com/sun/jersey/jersey-json/1.14/jersey-json-1.14.jar:/data/hive-ptest/working/maven/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/data/hive-ptest/working/maven/org/codehaus/jackson/jackson-xc/1.9.2/jackson-xc-1.9.2.jar:/data/hive-ptest/working/maven/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/data/hive-ptest/working/maven/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/data/hive-ptest/working/maven/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/data/hive-ptest/working/maven/commons-el/commons-el/1.0/commons-el-1.0.jar:/data/hive-ptest/working/maven/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/data/hive-ptest/working/maven/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/data/hive-ptest/working/maven/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/data/hive-ptest/working/maven/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/data/hive-ptest/working/maven/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/data/hive-ptest/working/maven/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/data/hive-ptest/working/maven/org/codehaus/jackson/jackson-core-asl/1.9.2/jackson-core-asl-1.9.2.jar:/data/hive-ptest/working/maven/org/codehaus/jackson/jackson-mapper-asl/1.9.2/jackson-mapper-asl-1.9.2.jar:/data/hive-ptest/working/maven/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-auth/2.4.0/hadoop-auth-2.4.0.jar:/data/hive-ptest/working/maven/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/data/hive-ptest/working/maven/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-common/2.4.0/hadoop-common-2.4.0-tests.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0-tests.jar:/data/hive-ptest/working/maven/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-hdfs/2.4.0/hadoop-hdfs-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.0/hadoop-mapreduce-client-jobclient-2.4.0-tests.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.0/hadoop-mapreduce-client-common-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.0/hadoop-mapreduce-client-shuffle-2.4.0.jar:/data/hive-ptest/working/maven/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/data/hive-ptest/working/maven/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-hs/2.4.0/hadoop-mapreduce-client-hs-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.0/hadoop-mapreduce-client-app-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-web-proxy/2.4.0/hadoop-yarn-server-web-proxy-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.0/hadoop-mapreduce-client-core-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-common/2.4.0/hadoop-yarn-common-2.4.0.jar:/data/hive-ptest/working/maven/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/data/hive-ptest/working/maven/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-tests/2.4.0/hadoop-yarn-server-tests-2.4.0-tests.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-common/2.4.0/hadoop-yarn-server-common-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-nodemanager/2.4.0/hadoop-yarn-server-nodemanager-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-resourcemanager/2.4.0/hadoop-yarn-server-resourcemanager-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-server-applicationhistoryservice/2.4.0/hadoop-yarn-server-applicationhistoryservice-2.4.0.jar:/data/hive-ptest/working/maven/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-api/2.4.0/hadoop-yarn-api-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-yarn-client/2.4.0/hadoop-yarn-client-2.4.0.jar:/data/hive-ptest/working/maven/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-common/0.98.3-hadoop2/hbase-common-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-common/0.98.3-hadoop2/hbase-common-0.98.3-hadoop2-tests.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-hadoop-compat/0.98.3-hadoop2/hbase-hadoop-compat-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-hadoop-compat/0.98.3-hadoop2/hbase-hadoop-compat-0.98.3-hadoop2-tests.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-hadoop2-compat/0.98.3-hadoop2/hbase-hadoop2-compat-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/com/yammer/metrics/metrics-core/2.1.2/metrics-core-2.1.2.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-hadoop2-compat/0.98.3-hadoop2/hbase-hadoop2-compat-0.98.3-hadoop2-tests.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-server/0.98.3-hadoop2/hbase-server-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-protocol/0.98.3-hadoop2/hbase-protocol-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-client/0.98.3-hadoop2/hbase-client-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-prefix-tree/0.98.3-hadoop2/hbase-prefix-tree-0.98.3-hadoop2.jar:/data/hive-ptest/working/maven/com/github/stephenc/high-scale-lib/high-scale-lib/1.1.1/high-scale-lib-1.1.1.jar:/data/hive-ptest/working/maven/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/data/hive-ptest/working/maven/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/data/hive-ptest/working/maven/org/codehaus/jackson/jackson-jaxrs/1.9.2/jackson-jaxrs-1.9.2.jar:/data/hive-ptest/working/maven/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/data/hive-ptest/working/maven/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/data/hive-ptest/working/maven/javax/activation/activation/1.1/activation-1.1.jar:/data/hive-ptest/working/maven/org/cloudera/htrace/htrace-core/2.04/htrace-core-2.04.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-client/2.2.0/hadoop-client-2.2.0.jar:/data/hive-ptest/working/maven/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.0/hadoop-mapreduce-client-jobclient-2.4.0.jar:/data/hive-ptest/working/maven/org/apache/hbase/hbase-server/0.98.3-hadoop2/hbase-server-0.98.3-hadoop2-tests.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-tests/0.4.0-incubating/tez-tests-0.4.0-incubating-tests.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-api/0.4.0-incubating/tez-api-0.4.0-incubating.jar:/data/hive-ptest/working/maven/org/apache/commons/commons-collections4/4.0/commons-collections4-4.0.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-runtime-library/0.4.0-incubating/tez-runtime-library-0.4.0-incubating.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-common/0.4.0-incubating/tez-common-0.4.0-incubating.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-mapreduce/0.4.0-incubating/tez-mapreduce-0.4.0-incubating.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-dag/0.4.0-incubating/tez-dag-0.4.0-incubating.jar:/data/hive-ptest/working/maven/org/apache/tez/tez-runtime-internals/0.4.0-incubating/tez-runtime-internals-0.4.0-incubating.jar:/data/hive-ptest/working/maven/com/google/inject/guice/3.0/guice-3.0.jar:/data/hive-ptest/working/maven/javax/inject/javax.inject/1/javax.inject-1.jar:/data/hive-ptest/working/maven/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/data/hive-ptest/working/maven/org/codehaus/jettison/jettison/1.3.4/jettison-1.3.4.jar:/data/hive-ptest/working/maven/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/data/hive-ptest/working/maven/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/clientpositive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/clientnegative
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/clientcompare
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/positive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/negative
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/hbase-handler/positive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/hbase-handler/negative
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/hbase-handler/minimrpositive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/contribpositive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/contribnegative
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/contribclientpositive
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/qfile-results/contribclientnegative
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/ql/parse/TestParse.java
from template TestParse.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/ql/parse/TestParseNegative.java
from template TestParseNegative.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCliDriver.java
from template TestCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestNegativeCliDriver.java
from template TestNegativeCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestCompareCliDriver.java
from template TestCompareCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestMinimrCliDriver.java
from template TestCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestMiniTezCliDriver.java
from template TestCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestNegativeMinimrCliDriver.java
from template TestNegativeCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/hbase-handler/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestHBaseCliDriver.java
from template TestHBaseCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/hbase-handler/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestHBaseMinimrCliDriver.java
from template TestHBaseCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/hbase-handler/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestHBaseNegativeCliDriver.java
from template TestHBaseNegativeCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestContribCliDriver.java
from template TestCliDriver.vm
Template Path:/data/hive-ptest/working/apache-svn-spark-source/ql/src/test/templates
Generated /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java/org/apache/hadoop/hive/cli/TestContribNegativeCliDriver.java
from template TestNegativeCliDriver.vm
[INFO] Executed tasks
[INFO] 
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-sources) @ hive-it-qfile
---
[INFO] Test Source directory: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/generated-test-sources/java
added.
[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-it-qfile
---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/src/test/resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-it-qfile ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/tmp
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/warehouse
    [mkdir] Created dir: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/tmp/conf
     [copy] Copying 8 files to /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/tmp/conf
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-it-qfile ---
[INFO] Compiling 14 source files to /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/test-classes
[INFO] 
[INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-it-qfile ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-it-qfile ---
[INFO] Building jar: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/hive-it-qfile-0.14.0-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-it-qfile ---
[INFO] 
[INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-it-qfile ---
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/target/hive-it-qfile-0.14.0-SNAPSHOT.jar
to /data/hive-ptest/working/maven/org/apache/hive/hive-it-qfile/0.14.0-SNAPSHOT/hive-it-qfile-0.14.0-SNAPSHOT.jar
[INFO] Installing /data/hive-ptest/working/apache-svn-spark-source/itests/qtest/pom.xml to
/data/hive-ptest/working/maven/org/apache/hive/hive-it-qfile/0.14.0-SNAPSHOT/hive-it-qfile-0.14.0-SNAPSHOT.pom
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Hive Integration - QFile Spark Tests 0.14.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-it-qfile-spark ---
[INFO] Deleting /data/hive-ptest/working/apache-svn-spark-source/itests/qtest-spark (includes
= [datanucleus.log, derby.log], excludes = [])
[INFO] 
[INFO] --- properties-maven-plugin:1.0-alpha-2:read-project-properties (default) @ hive-it-qfile-spark
---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Hive Integration - Parent ......................... SUCCESS [1.906s]
[INFO] Hive Integration - Custom Serde ................... SUCCESS [3.730s]
[INFO] Hive Integration - HCatalog Unit Tests ............ SUCCESS [3.627s]
[INFO] Hive Integration - Testing Utilities .............. SUCCESS [2.955s]
[INFO] Hive Integration - Unit Tests ..................... SUCCESS [3.118s]
[INFO] Hive Integration - Test Serde ..................... SUCCESS [0.901s]
[INFO] Hive Integration - QFile Tests .................... SUCCESS [2.484s]
[INFO] Hive Integration - QFile Spark Tests .............. FAILURE [0.295s]
[INFO] Hive Integration - Unit Tests - Hadoop 2 .......... SKIPPED
[INFO] Hive Integration - Unit Tests with miniKdc ........ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.338s
[INFO] Finished at: Tue Aug 12 23:00:35 EDT 2014
[INFO] Final Memory: 101M/755M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:properties-maven-plugin:1.0-alpha-2:read-project-properties
(default) on project hive-it-qfile-spark: Properties file not found: /data/hive-ptest/working/apache-svn-spark-source/itests/qtest-spark/../qtest/testconfiguration.properties
-> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hive-it-qfile-spark
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12661381

> ExecMapper static states lead to unpredictable query result.[Spark Branch]
> --------------------------------------------------------------------------
>
>                 Key: HIVE-7643
>                 URL: https://issues.apache.org/jira/browse/HIVE-7643
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Chengxiang Li
>         Attachments: HIVE-7643.1-spark.patch
>
>
> ExecMapper contain static states, static variable "done" for example. Spark executor
may execute multi tasks concurrently, ExecMapper static state updated by one task would influence
the logic of another task, which may lead to unpredictable result. To reproduce, execute 
> {code:sql}
> SELECT COUNT(*) FROM TEST TABLESAMPLE(1 ROWS) s
> {code}, 
> TEST should be a table with several blocks source data.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message