Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F06E47A05 for ; Tue, 27 Dec 2011 16:05:30 +0000 (UTC) Received: (qmail 96559 invoked by uid 500); 27 Dec 2011 16:05:30 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 96513 invoked by uid 500); 27 Dec 2011 16:05:30 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 96504 invoked by uid 99); 27 Dec 2011 16:05:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Dec 2011 16:05:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.8] (HELO aegis.apache.org) (140.211.11.8) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Dec 2011 16:05:26 +0000 Received: from aegis (localhost [127.0.0.1]) by aegis.apache.org (Postfix) with ESMTP id 1B409C00F2 for ; Tue, 27 Dec 2011 16:05:05 +0000 (UTC) Date: Tue, 27 Dec 2011 16:05:04 +0000 (UTC) From: Apache Jenkins Server To: dev@hive.apache.org Message-ID: <134757283.4251325001905031.JavaMail.hudson@aegis> In-Reply-To: <1945998300.3351324915336899.JavaMail.hudson@aegis> References: <1945998300.3351324915336899.JavaMail.hudson@aegis> Subject: Hive-trunk-h0.23.0 - Build # 50 - Still Failing MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Changes for Build #1 Changes for Build #2 [jvs] HIVE-2625. Fix maven-build Ant target (Carl Steinbach via jvs) Changes for Build #3 Changes for Build #4 [jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file (Marek Sapota via John Sichi) Summary: Remove property overrides Run `ant test Dtestcase=TestHiveServer && ant testreport`, the test report will be empty because not 'TEST*.xml' file was produced by JUnit. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 621 [jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v' (Carl Steinbach via jvs) Changes for Build #5 [hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan) [hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan) Changes for Build #6 Changes for Build #7 [heyongqiang] HIVE-1003 [jira] optimize metadata only queries (Namit Jain via Yongqiang He) Summary: testing Queries like: select max(ds) from T where ds is a partitioning column should be optimized. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: njain, heyongqiang Differential Revision: 105 Changes for Build #8 Changes for Build #9 [heyongqiang] HIVE-2634 [jira] revert HIVE-2566 (Namit Jain via Yongqiang He) Summary: HIVE-2634 This is leading to some problems. I will upload the offending testcase in a new jira. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 651 Changes for Build #10 [heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection (Namit Jain via Yongqiang He) Summary: HIVE-2632 Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 639 Changes for Build #11 Changes for Build #12 [heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars (Namit Jain via Yongqiang He) Summary: HIVE-2635 Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 687 [namit] HIVE-2329 Not using map aggregation, fails to execute group-by after cluster-by with same key (Navis via namit) Changes for Build #13 [namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader (He Yongqiang via namit) [namit] HIVE-2520 left semi join will duplicate data (binlijin via namit) [jvs] HIVE-1487 [jira] Add ptest script (Marek Sapota via John Sichi) Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still too slow. we should use parallel junit or some similar setup to run test queries in parallel. this should be really easy as well need to just use a separate warehouse/metadb and potentiall mapred system dir location. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 603 Changes for Build #14 Changes for Build #15 Changes for Build #16 Changes for Build #17 [jvs] Fix executable permissions left out of commit for HIVE-1487. Changes for Build #18 [jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes (Marek Sapota via John Sichi) Summary: Forcing Bash on each remote command call. Force use of Bash shell, so user default shell choice doesn't impact the test script. Test Plan: EMPTY Reviewers: JIRA, jsichi, njain Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 771 [jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present (Marek Sapota via John Sichi) Summary: Fix the task downloading Ant. Parallel tests should create directories as needed. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 777 Changes for Build #19 [jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person (Marek Sapota via John Sichi) Summary: Allow multiple ptest runs. Allow running ptest simultaneously, multiple times by one person on the same machines. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 783 [jvs] HIVE-2650 [jira] Parallel test commands that include cd fail (Marek Sapota via John Sichi) Summary: Add quotes around bash -c to fix commands using cd. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: mareksapotafb, jsichi Differential Revision: 801 [jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204 (Carl Steinbach via jvs) Changes for Build #20 Changes for Build #21 [jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based tests (Marek Sapota via John Sichi) Summary: Replace diff -I with regex masking in Java The current diff -I approach has two problems: (1) it does not allow resolution finer than line-level, so it's impossible to mask out pattern occurrences within a line, and (2) it produces unmasked files, so if you run diff on the command line to compare the result .q.out with the checked-in file, you see the noise. My suggestion is to first run sed to replace noise patterns with an unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files without using any -I. This would require a one-time hit to update all existing .q.out files so that they would contain the pre-masked results. Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: jsichi Differential Revision: 597 Changes for Build #22 Changes for Build #23 [namit] HIVE-2640 Add alterPartition to AlterHandler interface (Kevin Wilfong via namit) Changes for Build #24 [namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists (Chinna Rao Lalam via namit) Changes for Build #25 [namit] HIVE-2611 Make index table output of create index command if index is table based (Kevin Wilfong via namit) Changes for Build #26 [heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be changed (Namit Jain via Yongqiang He) Summary: HIVE-2651 It should be called hive.exec.mode.local.auto.input.files.max instead. The number of input files are checked currently. Test Plan: EMPTY Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang Differential Revision: 861 [cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws) Changes for Build #27 Changes for Build #28 [jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli POM does not depend on it either (Carl Steinbach via John Sichi) Summary: Make hive-cli and hive-ql depend on hive-builtins Test Plan: EMPTY Reviewers: JIRA, jsichi Reviewed By: jsichi CC: jsichi Differential Revision: 897 [namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or else folder creation fails (Chinna Rao Lalam via namit) Changes for Build #29 [hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan) Changes for Build #30 Changes for Build #31 Changes for Build #32 [cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws) Changes for Build #33 [cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws) Changes for Build #34 Changes for Build #35 Changes for Build #36 [namit] HIVE-2602 add support for insert partition overwrite(...) if not exists (Chinna Rao Lalam via namit) Changes for Build #37 Changes for Build #38 [cws] HIVE-2005. Implement BETWEEN operator (Navis via cws) Changes for Build #39 [jvs] HIVE-2433. add DOAP file for Hive Changes for Build #40 Changes for Build #41 Changes for Build #42 [heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join (Kevin Wilfong via Yongqiang He) Summary: Resource files are now added to the class path as soon as they are added via the CLI. This fixes the stack overflow error mentioned in the JIRA by ensuring a consistent class loader between serializers and deserializers for the same query. Note that now serdes which contain a static block to register themselves are now registered twice, once when adding the file to the class loader, and once when an instance of the class is created. Previously, registering a serde twice resulted in an exception, to avoid this, I have downgraded it to a warning. When a custom UDF is used as part of a join which is converted to a map join, the XMLEncoder enters an infinite loop when serializing the map reduce task for the second time, as part of sending it to be executed. This results in a stack overflow error. Test Plan: I ran the unit tests to verify nothing was broken. I ran several queries which used custom UDFs and involved a join which was converted to a map join. I verified these completed successfully consistently Reviewers: JIRA, heyongqiang Reviewed By: heyongqiang CC: heyongqiang, kevinwilfong Differential Revision: 957 [namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive (Yongqiang He via namit) Changes for Build #43 Changes for Build #44 Changes for Build #45 Changes for Build #46 [heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang) Changes for Build #47 Changes for Build #48 [cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws) Changes for Build #49 Changes for Build #50 No tests ran. The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #50) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/50/ to view the results.