giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-992) Zookeeper logs have too many NodeExists exceptions
Date Thu, 05 Feb 2015 19:08:38 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307785#comment-14307785
] 

Hudson commented on GIRAPH-992:
-------------------------------

ABORTED: Integrated in Giraph-trunk-Commit #1525 (See [https://builds.apache.org/job/Giraph-trunk-Commit/1525/])
GIRAPH-992 Zookeeper logs have too many NodeExists (edunov: http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=226fa4bb47a97ac825e05274cba77914f9c96252)
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/zk/ZooKeeperExt.java


> Zookeeper logs have too many NodeExists exceptions
> --------------------------------------------------
>
>                 Key: GIRAPH-992
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-992
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Sergey Edunov
>            Assignee: Sergey Edunov
>
> There are several places in our code where we do not check properly if zk node already
exists before attempting to create it. As a result ZK logs are full of these exceptions. 
> Biggest offender is recursive path creation in ZooKeeperExt.createExt(). Obviously if
part of the path already exists we don't need to create it. 
> Second biggest offender is writing input splits from master. Here we lunch multiple threads
each of them attempting to create the same path. 
> INFO    2015-02-04 14:32:39,730 [ProcessThread(sid:0 cport:-1):] org.apache.zookeeper.server.PrepRequestProcessor
 - Got user-level KeeperException when processing sessionid:0x14b56b9176f0001 type:create
cxid:0x1 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/_hadoopBsp/job_201411061513.83344_0001/_masterJobState
Error:KeeperErrorCode = NodeExists for /_hadoopBsp/job_201411061513.83344_0001/_masterJobState
> INFO    2015-02-04 14:32:39,740 [ProcessThread(sid:0 cport:-1):] org.apache.zookeeper.server.PrepRequestProcessor
 - Got user-level KeeperException when processing sessionid:0x14b56b9176f0001 type:create
cxid:0x3 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir
Error:KeeperErrorCode = NodeExists for /_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir
> INFO    2015-02-04 14:32:39,742 [ProcessThread(sid:0 cport:-1):] org.apache.zookeeper.server.PrepRequestProcessor
 - Got user-level KeeperException when processing sessionid:0x14b56b9176f0001 type:create
cxid:0x5 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir/0/_superstepDir
Error:KeeperErrorCode = NodeExists for /_hadoopBsp/job_201411061513.83344_0001/_applicationAttemptsDir/0/_superstepDir



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message