Return-Path: 
 <dev-return-52290-apmail-pig-dev-archive=pig.apache.org@pig.apache.org>
X-Original-To: apmail-pig-dev-archive@www.apache.org
Delivered-To: apmail-pig-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 81D481917C
	for <apmail-pig-dev-archive@www.apache.org>;
 Fri,  4 Mar 2016 18:20:41 +0000 (UTC)
Received: (qmail 92824 invoked by uid 500); 4 Mar 2016 18:20:41 -0000
Delivered-To: apmail-pig-dev-archive@pig.apache.org
Received: (qmail 92766 invoked by uid 500); 4 Mar 2016 18:20:41 -0000
Mailing-List: contact dev-help@pig.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@pig.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@pig.apache.org>
List-Post: <mailto:dev@pig.apache.org>
List-Id: <dev.pig.apache.org>
Reply-To: dev@pig.apache.org
Delivered-To: mailing list dev@pig.apache.org
Received: (qmail 92423 invoked by uid 500); 4 Mar 2016 18:20:41 -0000
Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org
Received: (qmail 92415 invoked by uid 99); 4 Mar 2016 18:20:41 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2016 18:20:41 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id DA2382C1F60
	for <pig-dev@hadoop.apache.org>; Fri,  4 Mar 2016 18:20:40 +0000 (UTC)
Date: Fri, 4 Mar 2016 18:20:40 +0000 (UTC)
From: "Xuefu Zhang (JIRA)" <jira@apache.org>
To: pig-dev@hadoop.apache.org
Message-ID: <JIRA.12946494.1456999411000.7695.1457115640890@Atlassian.JIRA>
In-Reply-To: <JIRA.12946494.1456999411000@Atlassian.JIRA>
References: <JIRA.12946494.1456999411000@Atlassian.JIRA>
 <JIRA.12946494.1456999411357@arcas>
Subject: [jira] [Updated] (PIG-4823) SparkMiniCluster does not cleanup old
 conf files during setup
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


     [ https://issues.apache.org/jira/browse/PIG-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xuefu Zhang updated PIG-4823:
-----------------------------
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to Spark branch. Thanks, Pallavi.

> SparkMiniCluster does not cleanup old conf files during setup
> -------------------------------------------------------------
>
>                 Key: PIG-4823
>                 URL: https://issues.apache.org/jira/browse/PIG-4823
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Pallavi Rao
>            Assignee: Pallavi Rao
>              Labels: spork
>             Fix For: spark-branch
>
>         Attachments: PIG-4823.patch
>
>
> If some of the tests fail or get killed, new tests will use the old hadoop conf files left behind by the previous tests, causing the following failure:
> {noformat}
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Could not create staging directory. 
> 	at org.apache.hadoop.mapreduce.v2.MiniMRYarnCluster.serviceInit(MiniMRYarnCluster.java:165)
> 	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
> 	at org.apache.pig.test.SparkMiniCluster.setupMiniDfsAndMrClusters(SparkMiniCluster.java:93)
> 	at org.apache.pig.test.MiniGenericCluster.buildCluster(MiniGenericCluster.java:86)
> 	at org.apache.pig.test.MiniGenericCluster.buildCluster(MiniGenericCluster.java:68)
> 	at org.apache.pig.test.TestToolsPigServer.<clinit>(TestToolsPigServer.java:42)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> 	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
> 	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1472)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1399)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
> 	at com.sun.proxy.$Proxy15.mkdirs(Unknown Source)
> 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:539)
> 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
> 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
> 	at com.sun.proxy.$Proxy16.mkdirs(Unknown Source)
> 	at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:2753)
> 	at org.apache.hadoop.fs.Hdfs.mkdir(Hdfs.java:311)
> 	at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:724)
> 	at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:720)
> 	at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
> 	at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:720)
> 	at org.apache.hadoop.mapreduce.v2.MiniMRYarnCluster.serviceInit(MiniMRYarnCluster.java:163)
> Caused by: java.net.ConnectException: Connection refused
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)