From issues-return-139184-archive-asf-public=cust-asf.ponee.io@hive.apache.org Mon Oct 8 11:07:04 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id C1EFD180652 for ; Mon, 8 Oct 2018 11:07:03 +0200 (CEST) Received: (qmail 68005 invoked by uid 500); 8 Oct 2018 09:07:02 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 67996 invoked by uid 99); 8 Oct 2018 09:07:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Oct 2018 09:07:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 82DF9C0158 for ; Mon, 8 Oct 2018 09:07:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -108.3 X-Spam-Level: X-Spam-Status: No, score=-108.3 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_BADIPHTTP=2, NORMAL_HTTP_TO_IP=0.001, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 0UKu9MlOD72h for ; Mon, 8 Oct 2018 09:07:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id E33205F16F for ; Mon, 8 Oct 2018 09:07:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 7573CE0A31 for ; Mon, 8 Oct 2018 09:07:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 15E28247CF for ; Mon, 8 Oct 2018 09:07:00 +0000 (UTC) Date: Mon, 8 Oct 2018 09:07:00 +0000 (UTC) From: "Hive QA (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-20707) Automatic MSCK REPAIR for external tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-20707?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1664= 1564#comment-16641564 ]=20 Hive QA commented on HIVE-20707: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12942766/HIVE-20707.1.patc= h {color:red}ERROR:{color} -1 due to build exiting with an error Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/14309/test= Report Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/14309/co= nsole Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-14309/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with e= xit status 1 and output '+ date '+%Y-%m-%d %T.%3N' 2018-10-08 09:05:40.280 + [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]] + export JAVA_HOME=3D/usr/lib/jvm/java-8-openjdk-amd64 + JAVA_HOME=3D/usr/lib/jvm/java-8-openjdk-amd64 + export PATH=3D/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/= bin:/bin:/usr/local/games:/usr/games + PATH=3D/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bi= n:/usr/local/games:/usr/games + export 'ANT_OPTS=3D-Xmx1g -XX:MaxPermSize=3D256m ' + ANT_OPTS=3D'-Xmx1g -XX:MaxPermSize=3D256m ' + export 'MAVEN_OPTS=3D-Xmx1g ' + MAVEN_OPTS=3D'-Xmx1g ' + cd /data/hiveptest/working/ + tee /data/hiveptest/logs/PreCommit-HIVE-Build-14309/source-prep.txt + [[ false =3D=3D \t\r\u\e ]] + mkdir -p maven ivy + [[ git =3D \s\v\n ]] + [[ git =3D \g\i\t ]] + [[ -z master ]] + [[ -d apache-github-source-source ]] + [[ ! -d apache-github-source-source/.git ]] + [[ ! -d apache-github-source-source ]] + date '+%Y-%m-%d %T.%3N' 2018-10-08 09:05:40.283 + cd apache-github-source-source + git fetch origin + git reset --hard HEAD HEAD is now at 61a027a HIVE-20623: Shared work: Extend sharing of map-join = cache entries in LLAP (Jesus Camacho Rodriguez, reviewed by Gopal V) + git clean -f -d Removing standalone-metastore/metastore-server/src/gen/ + git checkout master Already on 'master' Your branch is up-to-date with 'origin/master'. + git reset --hard origin/master HEAD is now at 61a027a HIVE-20623: Shared work: Extend sharing of map-join = cache entries in LLAP (Jesus Camacho Rodriguez, reviewed by Gopal V) + git merge --ff-only origin/master Already up-to-date. + date '+%Y-%m-%d %T.%3N' 2018-10-08 09:05:41.036 + rm -rf ../yetus_PreCommit-HIVE-Build-14309 + mkdir ../yetus_PreCommit-HIVE-Build-14309 + git gc + cp -R . ../yetus_PreCommit-HIVE-Build-14309 + mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-14309/yetus + patchCommandPath=3D/data/hiveptest/working/scratch/smart-apply-patch.sh + patchFilePath=3D/data/hiveptest/working/scratch/build.patch + [[ -f /data/hiveptest/working/scratch/build.patch ]] + chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh + /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/work= ing/scratch/build.patch error: a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java: does no= t exist in index error: a/data/conf/hive-site.xml: does not exist in index error: a/itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/txn/compa= ctor/TestCompactor.java: does not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java: does not = exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/metadata/CheckResult.java: d= oes not exist in index error: a/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecke= r.java: does not exist in index error: a/ql/src/test/org/apache/hadoop/hive/ql/exec/TestMsckCreatePartition= sInBatches.java: does not exist in index error: a/ql/src/test/org/apache/hadoop/hive/ql/exec/TestMsckDropPartitionsI= nBatches.java: does not exist in index error: a/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreCh= ecker.java: does not exist in index error: a/ql/src/test/results/clientpositive/msck_repair_drop.q.out: does no= t exist in index error: a/standalone-metastore/metastore-common/src/main/java/org/apache/had= oop/hive/metastore/Warehouse.java: does not exist in index error: a/standalone-metastore/metastore-common/src/main/java/org/apache/had= oop/hive/metastore/conf/MetastoreConf.java: does not exist in index error: a/standalone-metastore/metastore-common/src/main/java/org/apache/had= oop/hive/metastore/utils/MetaStoreUtils.java: does not exist in index error: a/standalone-metastore/metastore-server/src/main/java/org/apache/had= oop/hive/metastore/utils/MetaStoreServerUtils.java: does not exist in index error: patch failed: ql/src/test/results/clientpositive/msck_repair_drop.q.= out:58 error: repository lacks the necessary blob to fall back on 3-way merge. error: ql/src/test/results/clientpositive/msck_repair_drop.q.out: patch doe= s not apply error: src/java/org/apache/hadoop/hive/conf/HiveConf.java: does not exist i= n index error: patch failed: conf/hive-site.xml:349 Falling back to three-way merge... Applied patch to 'conf/hive-site.xml' with conflicts. error: hive-unit/src/test/java/org/apache/hadoop/hive/ql/txn/compactor/Test= Compactor.java: does not exist in index error: src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java: does not exist= in index error: src/java/org/apache/hadoop/hive/ql/metadata/CheckResult.java: does n= ot exist in index error: src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecker.jav= a: does not exist in index error: src/test/org/apache/hadoop/hive/ql/exec/TestMsckCreatePartitionsInBa= tches.java: does not exist in index error: src/test/org/apache/hadoop/hive/ql/exec/TestMsckDropPartitionsInBatc= hes.java: does not exist in index error: src/test/org/apache/hadoop/hive/ql/metadata/TestHiveMetaStoreChecker= .java: does not exist in index error: src/test/results/clientpositive/msck_repair_drop.q.out: does not exi= st in index error: metastore-common/src/main/java/org/apache/hadoop/hive/metastore/Ware= house.java: does not exist in index error: metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf= /MetastoreConf.java: does not exist in index error: metastore-common/src/main/java/org/apache/hadoop/hive/metastore/util= s/MetaStoreUtils.java: does not exist in index error: metastore-server/src/main/java/org/apache/hadoop/hive/metastore/util= s/MetaStoreServerUtils.java: does not exist in index The patch does not appear to apply with p0, p1, or p2 + result=3D1 + '[' 1 -ne 0 ']' + rm -rf yetus_PreCommit-HIVE-Build-14309 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12942766 - PreCommit-HIVE-Build > Automatic MSCK REPAIR for external tables > ----------------------------------------- > > Key: HIVE-20707 > URL: https://issues.apache.org/jira/browse/HIVE-20707 > Project: Hive > Issue Type: New Feature > Affects Versions: 4.0.0 > Reporter: Prasanth Jayachandran > Assignee: Prasanth Jayachandran > Priority: Major > Attachments: HIVE-20707.1.patch > > > In current scenario, to add partitions for external tables to metastore, = MSCK REPAIR command has to be executed manually. To avoid this manual step,= external tables can be specified a table property based on which a backgro= und metastore thread can add/drop/sync partitions periodically.=C2=A0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)