Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 06E71200CFA for ; Tue, 5 Sep 2017 21:00:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 055F61609EA; Tue, 5 Sep 2017 19:00:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 246EE1609E2 for ; Tue, 5 Sep 2017 21:00:08 +0200 (CEST) Received: (qmail 78069 invoked by uid 500); 5 Sep 2017 19:00:07 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 78058 invoked by uid 99); 5 Sep 2017 19:00:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Sep 2017 19:00:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id D2D52CEF9F for ; Tue, 5 Sep 2017 19:00:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id RXmv62zYnsMt for ; Tue, 5 Sep 2017 19:00:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 5FABE5F1EE for ; Tue, 5 Sep 2017 19:00:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 8AB80E099C for ; Tue, 5 Sep 2017 19:00:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3DE9224147 for ; Tue, 5 Sep 2017 19:00:00 +0000 (UTC) Date: Tue, 5 Sep 2017 19:00:00 +0000 (UTC) From: "Samarth Jain (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (PHOENIX-4159) phoenix-spark tests are failing MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 05 Sep 2017 19:00:10 -0000 Samarth Jain created PHOENIX-4159: ------------------------------------- Summary: phoenix-spark tests are failing Key: PHOENIX-4159 URL: https://issues.apache.org/jira/browse/PHOENIX-4159 Project: Phoenix Issue Type: Bug Reporter: Samarth Jain In few of the runs where we were able to get successful test runs for phoenix-core, we ran into failures for the phoenix-spark module. Sample run - https://builds.apache.org/job/Phoenix-master/1762/console [~jmahonin] - would you mind taking a look. Copy pasting here a possibly relevant stacktrace in case the link is no longer working: {code} Formatting using clusterid: testClusterID 1 [ScalaTest-4] ERROR org.apache.hadoop.hdfs.MiniDFSCluster - IOE creating namenodes. Permissions dump: path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/data': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/data permissions: ---- path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386 permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark permissions: drwx path '/home/jenkins/jenkins-slave/workspace/Phoenix-master': absolute:/home/jenkins/jenkins-slave/workspace/Phoenix-master permissions: drwx path '/home/jenkins/jenkins-slave/workspace': absolute:/home/jenkins/jenkins-slave/workspace permissions: drwx path '/home/jenkins/jenkins-slave': absolute:/home/jenkins/jenkins-slave permissions: drwx path '/home/jenkins': absolute:/home/jenkins permissions: drwx path '/home': absolute:/home permissions: dr-x path '/': absolute:/ permissions: dr-x java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:342) at org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:176) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:973) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:811) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:742) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:625) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1022) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:903) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:885) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:872) at org.apache.phoenix.query.BaseTest.initMiniCluster(BaseTest.java:522) at org.apache.phoenix.query.BaseTest.setUpTestCluster(BaseTest.java:442) at org.apache.phoenix.query.BaseTest.checkClusterInitialized(BaseTest.java:424) at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:495) at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:490) at org.apache.phoenix.end2end.BaseHBaseManagedTimeIT.doSetup(BaseHBaseManagedTimeIT.java:57) at org.apache.phoenix.spark.PhoenixSparkITHelper$.doSetup(AbstractPhoenixSparkIT.scala:33) at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:88) at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:44) at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253) at org.apache.phoenix.spark.AbstractPhoenixSparkIT.run(AbstractPhoenixSparkIT.scala:44) at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:55) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Exception encountered when invoking run on a nested suite - java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current *** ABORTED *** java.lang.RuntimeException: java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current at org.apache.phoenix.query.BaseTest.initMiniCluster(BaseTest.java:525) at org.apache.phoenix.query.BaseTest.setUpTestCluster(BaseTest.java:442) at org.apache.phoenix.query.BaseTest.checkClusterInitialized(BaseTest.java:424) at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:495) at org.apache.phoenix.query.BaseTest.setUpTestDriver(BaseTest.java:490) at org.apache.phoenix.end2end.BaseHBaseManagedTimeIT.doSetup(BaseHBaseManagedTimeIT.java:57) at org.apache.phoenix.spark.PhoenixSparkITHelper$.doSetup(AbstractPhoenixSparkIT.scala:33) at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:88) at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) at org.apache.phoenix.spark.AbstractPhoenixSparkIT.beforeAll(AbstractPhoenixSparkIT.scala:44) ... Cause: java.io.IOException: Cannot create directory /home/jenkins/jenkins-slave/workspace/Phoenix-master/phoenix-spark/target/test-data/fa615cb3-a0d9-4c9e-90eb-acd0c7d46d9b/dfscluster_1ce5f5c4-f355-4111-a763-4ab777941386/dfs/name1/current at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:337) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:548) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:569) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:161) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:991) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:342) at org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:176) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:973) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:811) at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:742) ... {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)