zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Han <h...@cloudera.com>
Subject Re: Config options not being loaded?
Date Thu, 21 Jul 2016 20:55:59 GMT
The fact that 'conf' does not print out all configuration options encoded
in zoo.cfg does not necessarily mean these options are not loaded in ZK. In
face the options 'conf' will print out is pretty limited and you can check
those options in ZooKeeperServerConf.java
<https://github.com/apache/zookeeper/blob/trunk/src/java/main/org/apache/zookeeper/server/ZooKeeperServerConf.java#L26>.
It'll be good to make this class up to date with regards to latest
available configuration options in ZK but most if not all configuration
options could also be validated in server logs (like the skipACL one here).

On Thu, Jul 21, 2016 at 11:55 AM, André Mantas <andremantas7@gmail.com>
wrote:

> Follow up:
> With start-foreground I'm able to see that skipACL=yes was effective (full
> output in the end of the email):
>
> 2016-07-21 20:36:19,433 [myid:] - INFO  [main:PrepRequestProcessor@87] -
> zookeeper.skipACL=="yes", ACL checks will be skipped
>
> What is the problem with the other config values? I'm trying to boost
> performance by disabling the persistency of zookeeper. I'm only interested
> in using zookeeper in memory database (no need for data persistency after
> reboot).
>
> Any advice on how to achieve this?
>
> Thanks
>
> -----
>
> ~/amantas/zookeeper-3.4.8# ./bin/zkServer.sh start-foreground
> ZooKeeper JMX enabled by default
> Using config: /root/amantas/zookeeper-3.4.8/bin/../conf/zoo.cfg
> 2016-07-21 20:36:15,060 [myid:] - INFO  [main:QuorumPeerConfig@103] -
> Reading configuration from:
> /root/amantas/zookeeper-3.4.8/bin/../conf/zoo.cfg
> 2016-07-21 20:36:15,069 [myid:] - INFO  [main:DatadirCleanupManager@78] -
> autopurge.snapRetainCount set to 3
> 2016-07-21 20:36:15,069 [myid:] - INFO  [main:DatadirCleanupManager@79] -
> autopurge.purgeInterval set to 0
> 2016-07-21 20:36:15,069 [myid:] - INFO  [main:DatadirCleanupManager@101] -
> Purge task is not scheduled.
> 2016-07-21 20:36:15,071 [myid:] - WARN  [main:QuorumPeerMain@113] - Either
> no config or no quorum defined in config, running  in standalone mode
> 2016-07-21 20:36:15,093 [myid:] - INFO  [main:QuorumPeerConfig@103] -
> Reading configuration from:
> /root/amantas/zookeeper-3.4.8/bin/../conf/zoo.cfg
> 2016-07-21 20:36:15,094 [myid:] - INFO  [main:ZooKeeperServerMain@95] -
> Starting server
> 2016-07-21 20:36:15,105 [myid:] - INFO  [main:Environment@100] - Server
> environment:zookeeper.version=3.4.8--1, built on 02/06/2016 03:18 GMT
> 2016-07-21 20:36:15,105 [myid:] - INFO  [main:Environment@100] - Server
> environment:host.name=t8.wan
> 2016-07-21 20:36:15,105 [myid:] - INFO  [main:Environment@100] - Server
> environment:java.version=1.8.0_91
> 2016-07-21 20:36:15,105 [myid:] - INFO  [main:Environment@100] - Server
> environment:java.vendor=Oracle Corporation
> 2016-07-21 20:36:15,105 [myid:] - INFO  [main:Environment@100] - Server
> environment:java.home=/usr/lib/jvm/java-8-oracle/jre
> 2016-07-21 20:36:15,106 [myid:] - INFO  [main:Environment@100] - Server
>
> environment:java.class.path=/root/amantas/zookeeper-3.4.8/bin/../build/classes:/root/amantas/zookeeper-3.4.8/bin/../build/lib/*.jar:/root/amantas/zookeeper-3.4.8/bin/../lib/slf4j-log4j12-1.6.1.jar:/root/amantas/zookeeper-3.4.8/bin/../lib/slf4j-api-1.6.1.jar:/root/amantas/zookeeper-3.4.8/bin/../lib/netty-3.7.0.Final.jar:/root/amantas/zookeeper-3.4.8/bin/../lib/log4j-1.2.16.jar:/root/amantas/zookeeper-3.4.8/bin/../lib/jline-0.9.94.jar:/root/amantas/zookeeper-3.4.8/bin/../zookeeper-3.4.8.jar:/root/amantas/zookeeper-3.4.8/bin/../src/java/lib/*.jar:/root/amantas/zookeeper-3.4.8/bin/../conf:
> 2016-07-21 20:36:15,106 [myid:] - INFO  [main:Environment@100] - Server
>
> environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> 2016-07-21 20:36:15,106 [myid:] - INFO  [main:Environment@100] - Server
> environment:java.io.tmpdir=/tmp
> 2016-07-21 20:36:15,106 [myid:] - INFO  [main:Environment@100] - Server
> environment:java.compiler=<NA>
> 2016-07-21 20:36:15,108 [myid:] - INFO  [main:Environment@100] - Server
> environment:os.name=Linux
> 2016-07-21 20:36:15,108 [myid:] - INFO  [main:Environment@100] - Server
> environment:os.arch=amd64
> 2016-07-21 20:36:15,108 [myid:] - INFO  [main:Environment@100] - Server
> environment:os.version=4.4.0-21-generic
> 2016-07-21 20:36:15,109 [myid:] - INFO  [main:Environment@100] - Server
> environment:user.name=root
> 2016-07-21 20:36:15,109 [myid:] - INFO  [main:Environment@100] - Server
> environment:user.home=/root
> 2016-07-21 20:36:15,109 [myid:] - INFO  [main:Environment@100] - Server
> environment:user.dir=/root/amantas/zookeeper-3.4.8
> 2016-07-21 20:36:15,118 [myid:] - INFO  [main:ZooKeeperServer@787] -
> tickTime set to 2000
> 2016-07-21 20:36:15,118 [myid:] - INFO  [main:ZooKeeperServer@796] -
> minSessionTimeout set to -1
> 2016-07-21 20:36:15,118 [myid:] - INFO  [main:ZooKeeperServer@805] -
> maxSessionTimeout set to -1
> 2016-07-21 20:36:15,132 [myid:] - INFO  [main:NIOServerCnxnFactory@89] -
> binding to port 0.0.0.0/0.0.0.0:2181
> 2016-07-21 20:36:19,433 [myid:] - INFO  [main:PrepRequestProcessor@87] -
> zookeeper.skipACL=="yes", ACL checks will be skipped
>
> André Mantas <andremantas7@gmail.com> escreveu no dia quinta, 21/07/2016
> às
> 03:28:
>
> > Hi all.
> >
> > I'm trying to experiment with some config options found in
> >
> https://zookeeper.apache.org/doc/r3.4.8/zookeeperAdmin.html#sc_configuration
> but
> > they are not being loaded/used by the zookeeper server.
> >
> > I've modified my config file 'zoo.cfg' to:
> >
> > # The number of milliseconds of each tick
> > tickTime=2000
> > # The number of ticks that the initial
> > # synchronization phase can take
> > initLimit=10
> > # The number of ticks that can pass between
> > # sending a request and getting an acknowledgement
> > syncLimit=5
> > # the directory where the snapshot is stored.
> > # do not use /tmp for storage, /tmp here is just
> > # example sakes.
> > dataDir=/root/amantas/zookeeper-3.4.8/data
> > # the port at which the clients will connect
> > clientPort=2181
> > # Requires updates to be synced to media of the transaction log before
> > finishing processing the update.
> > # If this option is set to no, ZooKeeper will not require updates to be
> > synced to the media.
> > forceSync=no
> > # Skips ACL checks. This results in a boost in throughput, but opens up
> > full access to the data tree to everyone.
> > skipACL=yes
> > # The observers now log transaction and write snapshot to disk by default
> > like the participants.
> > # This reduces the recovery time of the observers on restart.
> > # Set to "false" to disable this feature. Default is "true"
> > syncEnabled=false
> > # ZooKeeper logs transactions to a transaction log.
> > # After snapCount transactions are written to a log file a snapshot is
> > started and a new transaction log file is created.
> > # The default snapCount is 100,000
> > snapCount=1000000
> >
> > Then, restarted the zookeeper server:
> >
> > ~/amantas/zookeeper-3.4.8# ./bin/zkServer.sh stop
> > ZooKeeper JMX enabled by default
> > Using config: /root/amantas/zookeeper-3.4.8/bin/../conf/zoo.cfg
> > Stopping zookeeper ... STOPPED
> >
> > ~/amantas/zookeeper-3.4.8# ./bin/zkServer.sh start
> > ZooKeeper JMX enabled by default
> > Using config: /root/amantas/zookeeper-3.4.8/bin/../conf/zoo.cfg
> > Starting zookeeper ... STARTED
> >
> > However, when listing the server configuration I don't see some of the
> > config params:
> >
> > ~/amantas/zookeeper-3.4.8# nc localhost 2181
> > conf
> > clientPort=2181
> > dataDir=/root/amantas/zookeeper-3.4.8/data/version-2
> > dataLogDir=/root/amantas/zookeeper-3.4.8/data/version-2
> > tickTime=2000
> > maxClientCnxns=60
> > minSessionTimeout=4000
> > maxSessionTimeout=40000
> > serverId=0
> >
> > What am I doing wrong?
> >
> > Thanks in advance!
> >
>



-- 
Cheers
Michael.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message