www-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <lewis.mcgibb...@gmail.com>
Subject Setting file permission on Nutch Windows Builds
Date Fri, 22 Mar 2013 18:59:18 GMT
Hi Builds@,
A while back I tried to get nightly Nutch windows builds sorted out [0]. So
far so good.
The builds fail due to a failure to set some file permissions to 0700 which
is required by specific Nutch test processes.
A typical stack trace resulting in a failure can be seen below.
Can you guys suggest a possible solution I can configure within the Job to
configure this properly?
Thanks in advance.
Lewis

Testsuite: org.apache.nutch.crawl.TestCrawlDbFilter
Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 1.94 sec
------------- Standard Output ---------------
2013-03-22 04:07:50,070 WARN  util.NativeCodeLoader
(NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable
2013-03-22 04:07:50,099 INFO  compress.CodecPool
(CodecPool.java:getCompressor(103)) - Got brand-new compressor
2013-03-22 04:07:50,120 INFO  compress.CodecPool
(CodecPool.java:getCompressor(103)) - Got brand-new compressor
2013-03-22 04:07:50,121 INFO  crawl.CrawlDBTestUtil
(CrawlDBTestUtil.java:createCrawlDb(64)) -
adding:http://www.example.com
2013-03-22 04:07:50,122 INFO  crawl.CrawlDBTestUtil
(CrawlDBTestUtil.java:createCrawlDb(64)) -
adding:http://www.example1.com
2013-03-22 04:07:50,122 INFO  crawl.CrawlDBTestUtil
(CrawlDBTestUtil.java:createCrawlDb(64)) -
adding:http://www.example2.com
2013-03-22 04:07:50,332 ERROR security.UserGroupInformation
(UserGroupInformation.java:doAs(1139)) - PriviledgedActionException
as:hudson cause:java.io.IOException: Failed to set permissions of
path: \tmp\hadoop-hudson\mapred\staging\hudson-715448806\.staging to
0700
------------- ---------------- ---------------

Testcase: testUrl404Purging took 1.932 sec
	Caused an ERROR
Failed to set permissions of path:
\tmp\hadoop-hudson\mapred\staging\hudson-715448806\.staging to 0700
java.io.IOException: Failed to set permissions of path:
\tmp\hadoop-hudson\mapred\staging\hudson-715448806\.staging to 0700
	at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)
	at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662)
	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
	at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
	at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
	at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:918)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
	at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:886)
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1323)
	at org.apache.nutch.crawl.TestCrawlDbFilter.testUrl404Purging(TestCrawlDbFilter.java:101)

[0] https://builds.apache.org/view/M-R/view/Nutch/job/Nutch-trunk-Windows/
-- 
*Lewis*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message