Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of lewis.mcgibbney@gmail.com
 designates 209.85.217.182 as permitted sender)
MIME-Version: 1.0
Date: Thu, 10 Jan 2013 16:09:26 -0800
Message-ID: 
 <CAGaRif0V_VdUd7-WkjGmU8_b+uM3oY4xfFuJu=s3ncmFov2PKg@mail.gmail.com>
Subject: Failed to set permissions of path... staging to 0700 on Windows slave
 build
From: Lewis John Mcgibbney <lewis.mcgibbney@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=bcaec554d944caf85b04d2f81b41

--bcaec554d944caf85b04d2f81b41
Content-Type: text/plain; charset=ISO-8859-1

Hi All,

Occasionally we get users wanting to use Nutch on Windows boxes so I
thought it best to add some nightly builds for Nutch on Jenkins [0][1].

Initial results are that some tests fail. All with the following stack. Can
anyone suggest a quick script for me to add to the pre-build to set correct
permissions for the build?

Thank you very much in advance.

Lewis

java.io.IOException: Failed to set permissions of path:
\tmp\hadoop-hudson\mapred\staging\hudson1580335366\.staging to 0700
	at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
	at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
	at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
	at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
	at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:918)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
	at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:50)
	at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:191)
	at org.apache.nutch.crawl.GeneratorJob.generate(GeneratorJob.java:213)
	at org.apache.nutch.crawl.TestGenerator.generateFetchlist(TestGenerator.java:258)
	at org.apache.nutch.crawl.TestGenerator.testFilter(TestGenerator.java:228)


[0] https://builds.apache.org/view/M-R/view/Nutch/job/Nutch-2.x-Windows/
[1] https://builds.apache.org/view/M-R/view/Nutch/job/Nutch-trunk-Windows/

-- 
*Lewis*

--bcaec554d944caf85b04d2f81b41
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi All,<br><br>Occasionally we get users wanting to use Nutch on Windows bo=
xes so I thought it best to add some nightly builds for Nutch on Jenkins [0=
][1].<br><br>Initial results are that some tests fail. All with the followi=
ng stack. Can anyone suggest a quick script for me to add to the pre-build =
to set correct permissions for the build?<br>
<br>Thank you very much in advance.<br><br>Lewis<br><br><pre>java.io.IOExce=
ption: Failed to set permissions of path: \tmp\hadoop-hudson\mapred\staging=
\hudson1580335366\.staging to 0700
	at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
	at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSyste=
m.java:509)
	at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:=
344)
	at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
	at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmiss=
ionFiles.java:116)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:918)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati=
on.java:1136)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912=
)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
	at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:50)
	at org.apache.nutch.crawl.GeneratorJob.run(GeneratorJob.java:191)
	at org.apache.nutch.crawl.GeneratorJob.generate(GeneratorJob.java:213)
	at org.apache.nutch.crawl.TestGenerator.generateFetchlist(TestGenerator.ja=
va:258)
	at org.apache.nutch.crawl.TestGenerator.testFilter(TestGenerator.java:228)=
</pre><br><br>[0] <a href=3D"https://builds.apache.org/view/M-R/view/Nutch/=
job/Nutch-2.x-Windows/">https://builds.apache.org/view/M-R/view/Nutch/job/N=
utch-2.x-Windows/</a><br>
[1] <a href=3D"https://builds.apache.org/view/M-R/view/Nutch/job/Nutch-trun=
k-Windows/">https://builds.apache.org/view/M-R/view/Nutch/job/Nutch-trunk-W=
indows/</a><br clear=3D"all"><br>-- <br><font style=3D"font-family:courier =
new,monospace;background-color:rgb(255,255,255);color:rgb(51,102,255)" size=
=3D"4"><i>Lewis</i></font><span style=3D"background-color:rgb(255,255,255);=
color:rgb(51,102,255)"></span> <br>


--bcaec554d944caf85b04d2f81b41--