Return-Path: X-Original-To: apmail-manifoldcf-user-archive@www.apache.org Delivered-To: apmail-manifoldcf-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C983111A9A for ; Mon, 15 Sep 2014 13:04:14 +0000 (UTC) Received: (qmail 22629 invoked by uid 500); 15 Sep 2014 13:04:14 -0000 Delivered-To: apmail-manifoldcf-user-archive@manifoldcf.apache.org Received: (qmail 22578 invoked by uid 500); 15 Sep 2014 13:04:14 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 22568 invoked by uid 99); 15 Sep 2014 13:04:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Sep 2014 13:04:14 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lalit.j.jangra@gmail.com designates 209.85.160.176 as permitted sender) Received: from [209.85.160.176] (HELO mail-yk0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Sep 2014 13:04:10 +0000 Received: by mail-yk0-f176.google.com with SMTP id 131so1997682ykp.21 for ; Mon, 15 Sep 2014 06:03:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=/BOh7SR0s9hYywnm3Xd0ZvpNhJILBGIBpA8l2tpEwEo=; b=pQ1Cs/wqW7ZVDfaR3rUY5qHWXRVtbUmUwmkyYWW/NDC6/2d21+iNqmTlRYtbfT8uvj 9AN5XRj6KuIMmEo4Ijlpn5qXhQRf6QWGygaMGyxmwaGex/Gpv+qXf1WWmMg+TbtuQyKD Dqn3HnA8PRVxUyrYQH6K3lYD4gJAe7chQEJ4eNbxxFguSItEMIXuJzeqGKhlBAO9gRfu GKjqcrBYR/ZfKp4rmjap8ozQGE5WeBcF/lkOXmI8p47eEuKm5ujcRGe/pKFZlut6fn/S sJaXjO0suropgie1cjKDtEwqgPzNFmrx0B4JgbkPGlB94FmNxe/7YbiKLu2HyalHkdot balw== MIME-Version: 1.0 X-Received: by 10.236.25.203 with SMTP id z51mr486yhz.183.1410786229284; Mon, 15 Sep 2014 06:03:49 -0700 (PDT) Received: by 10.170.120.209 with HTTP; Mon, 15 Sep 2014 06:03:49 -0700 (PDT) Date: Mon, 15 Sep 2014 18:33:49 +0530 Message-ID: Subject: Getting errors in MCF logs for zookeeper From: lalit jangra To: "user@manifoldcf.apache.org" Content-Type: multipart/alternative; boundary=089e013d0c9e0cf1c905031a4466 X-Virus-Checked: Checked by ClamAV on apache.org --089e013d0c9e0cf1c905031a4466 Content-Type: text/plain; charset=UTF-8 Hi, I am running cluster of two Apache ManifoldCF nodes on two separate machines each of which having 3 zookeeper instances (total 6 instances in cluster). When i am running up manifoldCF agents, i see below warning during startup. [http-bio-80-exec-2] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=iwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=4000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@51d83fd7 [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma04.iwater.ie/10.231.72.25:2182. Will not attempt to authenticate using SASL (unknown error) [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma04.iwater.ie/10.231.72.25:2182, initiating session [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2182)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server iwdc2preecma04.iwater.ie/10.231.72.25:2182, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225) at sun.nio.ch.IOUtil.read(IOUtil.java:193) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:375) at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma04.iwater.ie/10.231.72.25:2183. Will not attempt to authenticate using SASL (unknown error) [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma04.iwater.ie/10.231.72.25:2183, initiating session [http-bio-80-exec-2-SendThread(iwdc2preecma04.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server iwdc2preecma04.iwater.ie/10.231.72.25:2183, sessionid = 0x6487851bd330078, negotiated timeout = 4000 [http-bio-80-exec-1] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=iwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=4000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@1a93346a [http-bio-80-exec-1-SendThread(iwdc1preecma03.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc1preecma03.iwater.ie/10.231.72.24:2183. Will not attempt to authenticate using SASL (unknown error) [http-bio-80-exec-1-SendThread(iwdc1preecma03.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc1preecma03.iwater.ie/10.231.72.24:2183, initiating session [http-bio-80-exec-1-SendThread(iwdc1preecma03.iwater.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server iwdc1preecma03.iwater.ie/10.231.72.24:2183, sessionid = 0x34878522d2b0085, negotiated timeout = 4000 [http-bio-80-exec-11] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=iwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=4000 watcher=org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@6dcb46fd [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma04.iwater.ie/10.231.72.25:2182. Will not attempt to authenticate using SASL (unknown error) [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma04.iwater.ie/10.231.72.25:2182, initiating session [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma04.iwater.ie/10.231.72.25:2181. Will not attempt to authenticate using SASL (unknown error) [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma04.iwater.ie/10.231.72.25:2181, initiating session [http-bio-80-exec-11-SendThread(iwdc2preecma04.iwater.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server iwdc2preecma04.iwater.ie/10.231.72.25:2181, sessionid = 0x4487851bd1d0081, negotiated timeout = 4000 Below are configurations for 1. zookeeper nodes & 2. MCF nodes for zookeeper. *zoo.cfg : Same for all six zookeeper nodes except for data & log dirs.* # The number of milliseconds of each tick tickTime=2000 dataDir=/app/IW/zookeeper/data/data.1 dataLogDir=/app/IW/zookeeper/logs/log.1 clientPort=2181 server.1=iwdc1preecma03:2888:3888 server.2=iwdc1preecma03:2889:3889 server.3=iwdc1preecma03:2890:3890 server.4=iwdc2preecma04:2891:3891 server.5=iwdc2preecma04:2892:3892 server.6=iwdc2preecma04:2893:3893 # The number of ticks that the initial # synchronization phase can take initLimit=10 # The number of ticks that can pass between # sending a request and getting an acknowledgement syncLimit=5 # the directory where the snapshot is stored. # do not use /tmp for storage, /tmp here is just # example sakes. #dataDir=/tmp/zookeeper # the port at which the clients will connect #clientPort=2181 # the maximum number of client connections. # increase this if you need to handle more clients #maxClientCnxns=60 # # Be sure to read the maintenance section of the # administrator guide before turning on autopurge. # # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance # # The number of snapshots to retain in dataDir autopurge.snapRetainCount=3 # Purge task interval in hours # Set to "0" to disable auto purge feature autopurge.purgeInterval=1 *ManifoldCF configurations : same for both ManifoldCF nodes.* *I want to know if due to above warnings/errors, will zookeeper stop working or will zookeeper will work and these are non-failing messages, because ManifoldCF jobs are stuck while i can see these errors.* Please suggest. Regards, Lalit. -- Regards, Lalit. --089e013d0c9e0cf1c905031a4466 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

= Hi,

I am running cluster of two Apache ManifoldCF nodes on two= separate machines each of which having 3 zookeeper instances (total 6 inst= ances in cluster). When i am running up manifoldCF agents, i see below warn= ing during startup.

[http-bio-80-exec-2] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=3Diwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183= ,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=3D4000 watcher=3Dorg.= apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@51d= 83fd7

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma0= 4.iwater.ie/10.231.72.25:2182. Will not attempt to authenticate using SASL (unknown error)

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma0= 4.iwater.ie/10.231.72.25:2182, initiating session

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2182)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server iwdc2preecma0= 4.iwater.ie/10.231.72.25:2182, unexpected error, closing socket connection and attempting reconnect

java.io.IOException: Connection reset by peer

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at sun.nio.ch.FileDispatcherImpl.read0(Native Method)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at sun.nio.ch.IOUtil.read(IOUtil.java:193)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:375)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:6= 8)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.ja= va:355)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma0= 4.iwater.ie/10.231.72.25:2183. Will not attempt to authenticate using SASL (unknown error)

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma0= 4.iwater.ie/10.231.72.25:2183, initiating session

[http-bio-80-exec-2-SendT= hread(iwdc2preecma04.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on se= rver iwdc2preecma0= 4.iwater.ie/10.231.72.25:2183, sessionid =3D 0x6487851bd330078, negotiated timeout =3D 4000

[http-bio-80-exec-1] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=3Diwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183= ,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=3D4000 watcher=3Dorg.= apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@1a9= 3346a

[http-bio-80-exec-1-SendT= hread(iwdc1preecma03.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc1preecma0= 3.iwater.ie/10.231.72.24:2183. Will not attempt to authenticate using SASL (unknown error)

[http-bio-80-exec-1-SendT= hread(iwdc1preecma03.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc1preecma0= 3.iwater.ie/10.231.72.24:2183, initiating session

[http-bio-80-exec-1-SendT= hread(iwdc1preecma03.iwate= r.ie:2183)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on se= rver iwdc1preecma0= 3.iwater.ie/10.231.72.24:2183, sessionid =3D 0x34878522d2b0085, negotiated timeout =3D 4000

[http-bio-80-exec-11] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=3Diwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183= ,iwdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183 sessionTimeout=3D4000 watcher=3Dorg.= apache.manifoldcf.core.lockmanager.ZooKeeperConnection$ZooKeeperWatcher@6dc= b46fd

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma0= 4.iwater.ie/10.231.72.25:2182. Will not attempt to authenticate using SASL (unknown error)

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma0= 4.iwater.ie/10.231.72.25:2182, initiating session

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2182)] INFO org.apache.zookeeper.ClientCnxn - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server iwdc2preecma0= 4.iwater.ie/10.231.72.25:2181. Will not attempt to authenticate using SASL (unknown error)

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to iwdc2preecma0= 4.iwater.ie/10.231.72.25:2181, initiating session

[http-bio-80-exec-11-Send= Thread(iwdc2preecma04.iwat= er.ie:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on se= rver iwdc2preecma0= 4.iwater.ie/10.231.72.25:2181, sessionid =3D 0x4487851bd1d0081, negotiated timeout =3D 4000

=C2=A0


Below are configurations for 1. zookeeper nodes & 2. MCF no= des for zookeeper.


zoo.cfg = :=C2=A0 Same for all six zookeeper nodes except for data & log dirs.


# The number of milliseconds of each tick

tickTime=3D2000

dataDir=3D/app/IW/zookeeper/dat= a/data.1

dataLogDir=3D/app/IW/zookeeper/= logs/log.1

clientPort=3D2181

server.1=3Diwdc1preecma03:2888:= 3888

server.2=3Diwdc1preecma03:2889:= 3889

server.3=3Diwdc1preecma03:2890:= 3890

server.4=3Diwdc2preecma04:2891:= 3891

server.5=3Diwdc2preecma04:2892:= 3892

server.6=3Diwdc2preecma04:2893:= 3893

# The number of ticks that the initial

# synchronization phase can take

initLimit=3D10

# The number of ticks that can pass between

# sending a request and getting an acknowledgement

syncLimit=3D5

# the directory where the snapshot is stored.

# do not use /tmp for storage, /tmp here is just

# example sakes.

#dataDir=3D/tmp/zookeeper

# the port at which the clients will connect

#clientPort=3D2181

# the maximum number of client connections.

# increase this if you need to handle more clients

#maxClientCnxns=3D60

#

# Be sure to read the maintenance section of the

# administrator guide before turning on autopurge.

#

# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance=

#

# The number of snapshots to retain in dataDir

autopurge.snapRetainCount=3D3

# Purge task interval in hours

# Set to "0" to disable auto purge feature

autopurge.purgeInterval=3D1


ManifoldCF configurations : same for= both ManifoldCF nodes.


<property name=3D"org.apache.manifoldcf.lockmanagerclass" value=3D"org.apache.manifoldcf.core.lockmanager.ZooKeeperLockManager&q= uot;/>

=C2=A0 <property name=3D"org.apache.manifoldcf.zookeeper.connectstring&quo= t; value=3D"iwdc1preecma03:2181,iwdc1preecma03:2182,iwdc1preecma03:2183,i= wdc2preecma04:2181,iwdc2preecma04:2182,iwdc2preecma04:2183"/>

<property name=3D"org.apache.manifoldcf.zookeeper.sessiontimeout" value=3D"4000"/>


=

I want to know if due to above warnings/errors, will zookeepe= r stop working or will zookeeper will work and these are non-failing messag= es, because ManifoldCF jobs are stuck while i can see these errors.

Please suggest.

Regards,
Lalit.



--
Regards,
Lalit.<= /div>
--089e013d0c9e0cf1c905031a4466--