Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 490B6200CFD for ; Wed, 6 Sep 2017 19:27:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 479081609C5; Wed, 6 Sep 2017 17:27:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 66D0C1609BB for ; Wed, 6 Sep 2017 19:27:09 +0200 (CEST) Received: (qmail 22872 invoked by uid 500); 6 Sep 2017 17:27:07 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 22861 invoked by uid 99); 6 Sep 2017 17:27:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Sep 2017 17:27:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id E885ACCAFD for ; Wed, 6 Sep 2017 17:27:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Zo08VAfKMiv7 for ; Wed, 6 Sep 2017 17:27:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 6CC415FE5F for ; Wed, 6 Sep 2017 17:27:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 77C78E00A9 for ; Wed, 6 Sep 2017 17:27:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 2D1DA23F0D for ; Wed, 6 Sep 2017 17:27:00 +0000 (UTC) Date: Wed, 6 Sep 2017 17:27:00 +0000 (UTC) From: "Josh Mahonin (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PHOENIX-4159) phoenix-spark tests are failing MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 06 Sep 2017 17:27:10 -0000 [ https://issues.apache.org/jira/browse/PHOENIX-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155739#comment-16155739 ] Josh Mahonin commented on PHOENIX-4159: --------------------------------------- Pushed to master, 4.x-HBase-1.2, 4.x-HBase-1.1, 4.x-HBase-0.98 > phoenix-spark tests are failing > ------------------------------- > > Key: PHOENIX-4159 > URL: https://issues.apache.org/jira/browse/PHOENIX-4159 > Project: Phoenix > Issue Type: Bug > Reporter: Samarth Jain > Attachments: PHOENIX-4159.patch > > > In few of the runs where we were able to get successful test runs for phoenix-core, we ran into failures for the phoenix-spark module. > Sample run - https://builds.apache.org/job/Phoenix-master/1762/console > [~jmahonin] - would you mind taking a look. Copy pasting here a possibly relevant stacktrace in case the link is no longer working: > {code} > Formatting using clusterid: testClusterID > 1 [ScalaTest-4] ERROR org.apache.hadoop.hdfs.MiniDFSCluster - IOE creating namenodes. Permissions dump: > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/data': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/data > permissions: ---- > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386 > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace/Phoenix-master': > absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master > permissions: drwx > path '/home/jenkins/jenkins-slave/workspace': > absolute:/home/jenkins/jenkins-slave/workspace > permissions: drwx > path '/home/jenkins/jenkins-slave': > absolute:/home/jenkins/jenkins-slave > permissions: drwx > path '/home/jenkins': > absolute:/home/jenkins > permissions: drwx > path '/home': > absolute:/home > permissions: dr-x > path '/': > absolute:/ > permissions: dr-x > java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current > at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337) > at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548) > at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569) > at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161) > at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991) > at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:342) > at org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:176) > at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:973) > at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:811) > at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:742) > at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:625) > at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1022) > at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:903) > at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:885) > at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:872) > at org.apache.phoenix.query.BaseTest.initMiniCluster(BaseTest.java:522) > at org.apache.phoenix.query.BaseTest.setUpTestCluster(BaseTest.java:442) > at org.apache.phoenix.query.BaseTest.checkClusterInitialized(BaseTest.java:424) > at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:495) > at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:490) > at org.apache.phoenix.end2end.BaseHBaseManagedTimeIT.doSetup(BaseHBaseManagedTimeIT.java:57) > at org.apache.phoenix.spark.PhoenixSparkITHelper$.doSetup(AbstractPhoenixSparkIT.scala:33) > at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:88) > at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) > at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:44) > at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253) > at org.apache.phoenix.spark.AbstractPhoenixSparkIT.run(AbstractPhoenixSparkIT.scala:44) > at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:55) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Exception encountered when invoking run on a nested suite - java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current *** ABORTED *** > java.lang.RuntimeException: java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current > at org.apache.phoenix.query.BaseTest.initMiniCluster(BaseTest.java:525) > at org.apache.phoenix.query.BaseTest.setUpTestCluster(BaseTest.java:442) > at org.apache.phoenix.query.BaseTest.checkClusterInitialized(BaseTest.java:424) > at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:495) > at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:490) > at org.apache.phoenix.end2end.BaseHBaseManagedTimeIT.doSetup(BaseHBaseManagedTimeIT.java:57) > at org.apache.phoenix.spark.PhoenixSparkITHelper$.doSetup(AbstractPhoenixSparkIT.scala:33) > at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:88) > at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) > at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:44) > ... > Cause: java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current > at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337) > at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548) > at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569) > at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161) > at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991) > at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:342) > at org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:176) > at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:973) > at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:811) > at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:742) > ... > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)