giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-442) FileNotFoundException: <baseDirectory>/_zkServer is checked before it is created
Date Mon, 18 Nov 2013 22:13:26 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825838#comment-13825838
] 

Hudson commented on GIRAPH-442:
-------------------------------

SUCCESS: Integrated in Giraph-trunk-Commit #1366 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1366/])
GIRAPH-442 (claudio.martella: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=52a6d3e6aa04c977310f0dc46bb18901812e272a)
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/zk/ZooKeeperManager.java


> FileNotFoundException: <baseDirectory>/_zkServer is checked before it is created
> --------------------------------------------------------------------------------
>
>                 Key: GIRAPH-442
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-442
>             Project: Giraph
>          Issue Type: Bug
>          Components: zookeeper
>    Affects Versions: 1.0.0
>            Reporter: Mitesh Singh Jat
>             Fix For: 1.0.0
>
>         Attachments: GIRAPH-442.1.patch, GIRAPH-442.diff, GIRAPH-442.diff, giraph-442.git.patch,
giraph-442.patch
>
>
> On running following command
> {code}
> $ hadoop fs -rm -r -skipTrash /tmp/giraph/cc/_bsp/_defaultZkManagerDir/
> $ hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.23.1-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark
-Dmapreduce.jobtracker.address=jt1.myorg.org:port -Dgiraph.zkManagerDirectory='/tmp/giraph/cc/_bsp/_defaultZkManagerDir'
-e 1 -s 3 -v -V 500000 -w 30
> {code}
> The ZooKeeper Server fails with FileNotFoundException
> {noformat}
> 2012-12-05 11:04:26,932 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Made the directory /tmp/giraph/cc/_bsp/_defaultZkManagerDir
> 2012-12-05 11:04:26,935 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createCandidateStamp:
Creating my filestamp /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_task/machine.myorg.org 0
> 2012-12-05 11:04:26,965 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
Got [machine30955.myorg.org, machine31086.myorg.org, machine31116.myorg.org, machine31228.myorg.org,
machine31245.myorg.org, machine31354.myorg.org, machine31361.myorg.org, machine31405.myorg.org,
machine31631.myorg.org, machine31753.myorg.org, machine31782.myorg.org, machine31845.myorg.org,
machine32065.myorg.org, machine32067.myorg.org, machine32089.myorg.org, machine32217.myorg.org,
machine32229.myorg.org, machine32347.myorg.org, machine32400.myorg.org, machine32434.myorg.org,
machine32517.myorg.org, machine32663.myorg.org, machine32830.myorg.org, machine33208.myorg.org,
machine33228.myorg.org, machine33482.myorg.org, machine33491.myorg.org, machine33765.myorg.org,
machine.myorg.org] 29 hosts from 29 candidates when 1 required (polling period is 3000) on
attempt 0
> 2012-12-05 11:04:26,965 INFO [main] org.apache.giraph.zk.ZooKeeperManager: createZooKeeperServerList:
Creating the final ZooKeeper file '/tmp/giraph/cc/_bsp/_defaultZkManagerDir/zkServerList_machine30955.myorg.org
13 '
> 2012-12-05 11:04:26,972 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
For task 0, got file 'zkServerList_machine30955.myorg.org 13 ' (polling period is 3000)
> 2012-12-05 11:04:26,973 INFO [main] org.apache.giraph.zk.ZooKeeperManager: getZooKeeperServerList:
Found [machine30955.myorg.org, 13] 2 hosts in filename 'zkServerList_machine30955.myorg.org
13 '
> 2012-12-05 11:04:26,977 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running
child : java.lang.IllegalStateException: run: Caught an unrecoverable exception java.io.FileNotFoundException:
File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer does not exist.
>     at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:768)
>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:726)
>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333)
>     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:396)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1212)
>     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer
does not exist.
>     at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:796)
>     at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:390)
>     at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:737)
>     ... 7 more
> Caused by: java.io.FileNotFoundException: File /tmp/giraph/cc/_bsp/_defaultZkManagerDir/_zkServer
does not exist.
>     at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:362)
>     at org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:755)
>     ... 9 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message