giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avery Ching (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-387) GiraphRunner's better handling of configuration property arguments
Date Thu, 25 Oct 2012 04:06:12 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13483881#comment-13483881
] 

Avery Ching commented on GIRAPH-387:
------------------------------------

Not sure why, but we got a session expired event from the test.  Restarted the build and it
passed fine.

One of these days we should fix the below problem.

12/10/25 02:24:18 FATAL graph.GraphMapper: uncaughtException: OverrideExceptionHandler on
thread org.apache.giraph.graph.MasterThread, msg = getWorkers: Got KeeperException, exiting...
java.lang.IllegalStateException: getWorkers: Got KeeperException
	at org.apache.giraph.graph.BspServiceMaster.getWorkerInfosFromPath(BspServiceMaster.java:323)
	at org.apache.giraph.graph.BspServiceMaster.superstepChosenWorkerAlive(BspServiceMaster.java:1021)
	at org.apache.giraph.graph.BspServiceMaster.barrierOnWorkerList(BspServiceMaster.java:1199)
	at org.apache.giraph.graph.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1342)
	at org.apache.giraph.graph.MasterThread.run(MasterThread.java:112)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode =
Session expired for /_hadoopBsp/job_local_0008/_applicationAttemptsDir/0/_superstepDir/1/_workerHealthyDir
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1243)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1271)
	at org.apache.giraph.zk.ZooKeeperExt.getChildrenExt(ZooKeeperExt.java:504)
	at org.apache.giraph.graph.BspServiceMaster.getWorkerInfosFromPath(BspServiceMaster.java:320)
	... 4 more
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 WARN zk.ZooKeeperManager: onlineZooKeeperServers: Forced a shutdown hook
kill of the ZooKeeper process.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: onlineZooKeeperServers: ZooKeeper process exited
with 1 (note that 143 typically means killed).
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
12/10/25 02:24:18 WARN zk.ZooKeeperManager: onlineZooKeeperServers: Forced a shutdown hook
kill of the ZooKeeper process.
12/10/25 02:24:18 INFO zk.ZooKeeperManager: onlineZooKeeperServers: ZooKeeper process exited
with 1 (note that 143 typically means killed).
12/10/25 02:24:18 INFO zk.ZooKeeperManager: run: Shutdown hook started.
[INFO] ------------------------------------------------------------------------
                
> GiraphRunner's better handling of configuration property arguments
> ------------------------------------------------------------------
>
>                 Key: GIRAPH-387
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-387
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Jaeho Shin
>            Assignee: Jaeho Shin
>            Priority: Minor
>         Attachments: GIRAPH-387-2.patch, GIRAPH-387.patch
>
>
> After GiraphConfiguration came along (GIRAPH-337?), GiraphRunner started to forget all
configuration properties passed as -D arguments, and picked up by ToolRunner.  I'm submitting
a one-line fix for that, plus a small improvement to GiraphRunner's {{-ca}} option.
> Previously, to pass multiple custom arguments over the {{-ca}} option, we had to join
all the name=value pairs with comma and only the last one had effect.  This was not so practical
for many of my use cases, so I made some change to GiraphRunner that let us use as many {{-ca}}
options as we want.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message