accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Medinets <david.medin...@gmail.com>
Subject Master Not Writing Log Messages
Date Tue, 17 Nov 2015 02:45:45 GMT
I've been away from actively using Accumulo for the last year but I didn't
think the installation and configuration had changed. However, I'm trying
to run v1.7 inside a docker instance and several processes are not writing
log messages. This has worked for me in the past so I assume that I am
doing something wrong. But I can't see what.

I was going to create a jira ticket but I didn't want to call this a bug
without someone checking my process.

Here is the Docker file. It builds on an hadoop instance from sequenceiq.
The docker file just downloads zookeeper and accumulo. Then defines the
environment variables. I am using the 1GB example configuration files with
no changes.

---

FROM sequenceiq/hadoop-docker

RUN cd /usr/local && \
  curl --silent -O
http://mirror.metrocast.net/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
&& \
  tar xfz zookeeper-3.4.6.tar.gz && \
  ln -s /usr/local/zookeeper-3.4.6 /usr/local/zookeeper && \
  cp /usr/local/zookeeper-3.4.6/conf/zoo_sample.cfg
/usr/local/zookeeper-3.4.6/conf/zoo.cfg && \
  rm zookeeper-3.4.6.tar.gz

RUN cd /usr/local && \
  curl -O
http://supergsego.com/apache/accumulo/1.7.0/accumulo-1.7.0-bin.tar.gz && \
  tar xvfz accumulo-1.7.0-bin.tar.gz && \
  ln -s /usr/local/accumulo-1.7.0 /usr/local/accumulo && \
  rm accumulo-1.7.0-bin.tar.gz && \
  cp /usr/local/accumulo-1.7.0/conf/examples/1GB/standalone/*
/usr/local/accumulo-1.7.0/conf && \
  mkdir /var/log/accumulo

ENV ACCUMULO_HOME    /usr/local/accumulo
ENV JAVA_HOME        /usr/java/jdk1.7.0_71
ENV HADOOP_PREFIX    /usr/local/hadoop
ENV ACCUMULO_LOG_DIR /var/log/accumulo
ENV ZOOKEEPER_HOME   /usr/local/zookeeper

ENV PATH $PATH:$ACCUMULO_HOME/bin:$HADOOP_PREFIX/bin:$ZOOKEEPER_HOME/bin

EXPOSE 2181
EXPOSE 50095

ADD instance-setup.sh /

----

The instance is run using this command:

docker run -itP medined/myaccumulo /bin/bash

If you have docker, you can run the command locally. Once the container is
running, start hadoop, zookeeper, and accumulo using:

./instance-setup.sh

Everything is running:

bash-4.1# ps faux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0  11488  2492 ?        Ss   21:31   0:00 /bin/bash
root        29  0.0  0.0  66272  2572 ?        Ss   21:31   0:00
/usr/sbin/sshd
root       135  5.2  4.7 1584636 192844 ?      Sl   21:31   0:06
/usr/java/default/bin/java -Dproc_namenode -Xmx1000m
-Djava.net.preferIPv4Stack=tr
root       257  4.8  4.0 1582444 166256 ?      Sl   21:31   0:05
/usr/java/default/bin/java -Dproc_datanode -Xmx1000m
-Djava.net.preferIPv4Stack=tr
root       421  3.6  3.3 1558608 135284 ?      Sl   21:31   0:04
/usr/java/default/bin/java -Dproc_secondarynamenode -Xmx1000m
-Djava.net.preferIPv
root       579  6.7  4.4 1749200 182848 ?      Tl   21:31   0:07
/usr/java/default/bin/java -Dproc_resourcemanager -Xmx1000m
-Dhadoop.log.dir=/usr/
root       676  5.8  4.0 1615664 164648 ?      Sl   21:31   0:06
/usr/java/default/bin/java -Dproc_nodemanager -Xmx1000m
-Dhadoop.log.dir=/usr/loca
root       745  0.8  1.0 2576616 41484 ?       Tl   21:31   0:00
/usr/java/jdk1.7.0_71/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,
root      1108  6.0  2.4 428560 101116 ?       Tl   21:32   0:04
/usr/java/jdk1.7.0_71/bin/java -Dapp=monitor -XX:+UseConcMarkSweepGC
-XX:CMSInitia
root      1183  7.0  4.9 767524 203560 ?       Tl   21:32   0:05
/usr/java/jdk1.7.0_71/bin/java -Dapp=tserver -XX:+UseConcMarkSweepGC
-XX:CMSInitia
root      1347  1.1  1.2 447032 50928 ?        Tl   21:32   0:00
/usr/java/jdk1.7.0_71/bin/java -Dapp=master -XX:+UseConcMarkSweepGC
-XX:CMSInitiat
root      1500  0.0  0.0  11364  2396 ?        T    21:32   0:00  \_ sh -c
stty -icanon min 1 -icrnl -inlcr -ixon < /dev/tty
root      1501  0.0  0.0   4168   436 ?        T    21:32   0:00      \_
stty -icanon min 1 -icrnl -inlcr -ixon
root      1399  1.0  1.1 380544 48688 ?        Tl   21:32   0:00
/usr/java/jdk1.7.0_71/bin/java -Dapp=gc -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingO
root      1457  0.9  1.1 447240 47188 ?        Tl   21:32   0:00
/usr/java/jdk1.7.0_71/bin/java -Dapp=tracer -XX:+UseConcMarkSweepGC
-XX:CMSInitiat

But the master is not writing log files.

bash-4.1# ls -l
total 100
-rw-r--r-- 1 root root     0 Nov 16 21:32 a77a69311cec.audit
-rw-r--r-- 1 root root     0 Nov 16 21:32 gc_localhost.err
-rw-r--r-- 1 root root     0 Nov 16 21:32 gc_localhost.out
-rw-r--r-- 1 root root     0 Nov 16 21:32 master_localhost.err
-rw-r--r-- 1 root root     0 Nov 16 21:32 master_localhost.out
-rw-r--r-- 1 root root 23610 Nov 16 21:32 monitor_a77a69311cec.debug.log
-rw-r--r-- 1 root root 22605 Nov 16 21:32 monitor_a77a69311cec.log
-rw-r--r-- 1 root root     0 Nov 16 21:32 monitor_localhost.err
-rw-r--r-- 1 root root   158 Nov 16 21:32 monitor_localhost.out
-rw-r--r-- 1 root root     0 Nov 16 21:32 tracer_localhost.err
-rw-r--r-- 1 root root     0 Nov 16 21:32 tracer_localhost.out
-rw-r--r-- 1 root root 21465 Nov 16 21:32 tserver_a77a69311cec.debug.log
-rw-r--r-- 1 root root 20284 Nov 16 21:32 tserver_a77a69311cec.log
-rw-r--r-- 1 root root     0 Nov 16 21:32 tserver_localhost.err
-rw-r--r-- 1 root root   158 Nov 16 21:32 tserver_localhost.out

The monitor log file does have this message:

2015-11-16 21:32:29,952 [impl.MasterClient] DEBUG:  No masters...

Any ideas?

Mime
View raw message