hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: possible bug in zookeeper ?
Date Tue, 14 Sep 2010 16:30:06 GMT
Also try the four letter commands to each server.

On Tue, Sep 14, 2010 at 9:20 AM, Patrick Hunt <phunt@apache.org> wrote:

> That is unusual. I don't recall anyone reporting a similar issue, and
> looking at the code I don't see any issues off hand. Can you try the
> following?
>
> 1) on that particular zk client machine resolve the hosts
> zook1/zook2/zook3,
> what ip addresses does this resolve to? (try dig)
> 2) try running the client using the 3.3.1 jar file (just replace the jar on
> the client), it includes more log4j information, turn on DEBUG or TRACE
> logging
>
> Patrick
>
> On Tue, Sep 14, 2010 at 8:44 AM, Yatir Ben Shlomo <yatirb@outbrain.com
> >wrote:
>
> > zook1:2181,zook2:2181,zook3:2181
> >
> >
> > -----Original Message-----
> > From: Ted Dunning [mailto:ted.dunning@gmail.com]
> > Sent: Tuesday, September 14, 2010 4:11 PM
> > To: zookeeper-user@hadoop.apache.org
> > Subject: Re: possible bug in zookeeper ?
> >
> > What was the list of servers that was given originally to open the
> > connection to ZK?
> >
> > On Tue, Sep 14, 2010 at 6:15 AM, Yatir Ben Shlomo <yatirb@outbrain.com
> > >wrote:
> >
> > > Hi I am using solrCloud which uses an ensemble of 3 zookeeper
> instances.
> > >
> > > I am performing survivability  tests:
> > > Taking one of the zookeeper instances down I would expect the client to
> > use
> > > a different zookeeper server instance.
> > >
> > > But as you can see in the below logs attached
> > > Depending on which instance I choose to take down (in my case,  the
> last
> > > one in the list of zookeeper servers)
> > > the client is constantly insisting on the same zookeeper server
> > (Attempting
> > > connection to server zook3/192.168.252.78:2181)
> > > and not switching to a different one
> > > the problem seems to arrive from ClientCnxn.java
> > > Any one has an idea on this ?
> > >
> > > Solr cloud currently is using  zookeeper-3.2.2.jar
> > > Is this a know bug that was fixed in later versions ?( 3.3.1)
> > >
> > > Thanks in advance,
> > > Yatir
> > >
> > >
> > > Logs:
> > >
> > > Sep 14, 2010 9:02:20 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown input
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):999)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > > Sep 14, 2010 9:02:20 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown output
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):1004)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category info
> > > INFO: Attempting connection to server zook3/192.168.252.78:2181
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Exception closing session 0x32b105244a20001 to
> > > sun.nio.ch.SelectionKeyImpl@3ca58cbf
> > > java.net.ConnectException: Connection refused
> > >        at sun.nio.ch.SocketChannelImpl.$$YJP$$checkConnect(Native
> Method)
> > >        at
> > sun.nio.ch.SocketChannelImpl.checkConnect(SocketChannelImpl.java)
> > >        at
> > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):933)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown input
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):999)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown output
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):1004)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category info
> > > INFO: Attempting connection to server zook3/192.168.252.78:2181
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Exception closing session 0x32b105244a20000 to
> > > sun.nio.ch.SelectionKeyImpl@3960f81b
> > > java.net.ConnectException: Connection refused
> > >        at sun.nio.ch.SocketChannelImpl.$$YJP$$checkConnect(Native
> Method)
> > >        at
> > sun.nio.ch.SocketChannelImpl.checkConnect(SocketChannelImpl.java)
> > >        at
> > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):933)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown input
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):999)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > > Sep 14, 2010 9:02:22 AM org.apache.log4j.Category warn
> > > WARNING: Ignoring exception during shutdown output
> > > java.nio.channels.ClosedChannelException
> > >        at
> > > sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649)
> > >        at
> sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):1004)
> > >        at
> > >
> >
> org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message