Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 56739100EF for ; Wed, 19 Mar 2014 13:14:15 +0000 (UTC) Received: (qmail 65809 invoked by uid 500); 19 Mar 2014 13:14:14 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 65414 invoked by uid 500); 19 Mar 2014 13:14:12 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 65395 invoked by uid 99); 19 Mar 2014 13:14:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Mar 2014 13:14:10 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of josh.elser@gmail.com designates 209.85.214.176 as permitted sender) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Mar 2014 13:14:02 +0000 Received: by mail-ob0-f176.google.com with SMTP id wp18so7973103obc.7 for ; Wed, 19 Mar 2014 06:13:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ucXyK4lReShYL9mskY1Qze00VKsYhzwE0SzjYFy9kFc=; b=lrHsWxKAZKRUmIk8iK0aot9m+9BMJSBAKkNl6A4Ii+HRB6cY5s0pqxl5yIhU9GZBkV CA8doh+qLhYXHYAZ6B96JXDzC6B/rNmmFAX+oQMlrcHypIWW7bBtbs+ZuEfOz+rbfR4H vYHFpc9HP5+1wkY6JzHzF3ZXhPeoIE2dTvv+Q8J3+16bs/V3reCMohWxNCVnlBaK1Dlk mQtWirp4pqNP2JyseYdRiNZ/0ORK8BoudoUi5EEqWTHruakmxDCpdgqmkOr8pnslFIZn Wn6h39FtjeV6SHpfg2/F4mSh+FY2/uvldTUsLPrULXktNLZRwvaVo5cRuJJTb5AhquJc hBiQ== MIME-Version: 1.0 X-Received: by 10.182.230.135 with SMTP id sy7mr1939888obc.24.1395234821901; Wed, 19 Mar 2014 06:13:41 -0700 (PDT) Received: by 10.76.93.173 with HTTP; Wed, 19 Mar 2014 06:13:41 -0700 (PDT) Received: by 10.76.93.173 with HTTP; Wed, 19 Mar 2014 06:13:41 -0700 (PDT) In-Reply-To: References: Date: Wed, 19 Mar 2014 09:13:41 -0400 Message-ID: Subject: Re: Installing with Hadoop 2.2.0 From: Josh Elser To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a11c33676f01a0904f4f56bfa X-Virus-Checked: Checked by ClamAV on apache.org --001a11c33676f01a0904f4f56bfa Content-Type: text/plain; charset=UTF-8 I think by default zkCli.sh will just try to connect to localhost. You can change this by providing the quorum string to the script with the -server option. On Mar 19, 2014 8:29 AM, "Benjamin Parrish" wrote: > I adjusted accumulo-env.sh to have hard coded values as seen below. > > Are there any logs that could shed some light on this issue? > > If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6. > > I also ran across this, that didn't look right... > > Welcome to ZooKeeper! > 2014-03-19 08:25:53,479 [myid:] - INFO > [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening > socket connection to server localhost/127.0.0.1:2181. Will not attempt to > authenticat > e using SASL (unknown error) > 2014-03-19 08:25:53,483 [myid:] - INFO > [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket > connection established to localhost/127.0.0.1:2181, initiating session > JLine support is enabled > [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] - INFO > [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session > establishment complete on server localhost/127.0. > 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000 > > should ZooKeeper try to hit localhost/127.0.0.1? > > my zoo.cfg looks like this.... > tickTime=2000 > initLimit=10 > syncLimit=5 > dataDir=/usr/local/zookeeper/data > clientPort=2181 > server.1=hadoop-node-1:2888:3888 > server.2=hadoop-node-2:2888:3888 > server.3=hadoop-node-3:2888:3888 > server.4=hadoop-node-4:2888:3888 > server.5=hadoop-node-5:2888:3888 > > #! /usr/bin/env bash > > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the "License"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > # http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an "AS IS" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > > ### > ### Configure these environment variables to point to your local > installations. > ### > ### The functional tests require conditional values, so keep this style: > ### > ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0 > ### > ### > ### Note that the -Xmx -Xms settings below require substantial free memory: > ### you may want to use smaller values, especially when running everything > ### on a single machine. > ### > if [ -z "$HADOOP_HOME" ] > then > test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop > else > HADOOP_PREFIX="$HADOOP_HOME" > unset HADOOP_HOME > fi > # test -z "$HADOOP_CONF_DIR" && export > HADOOP_CONF_DIR="/usr/local/hadoop/conf" > # hadoop-2.0: > test -z "$HADOOP_CONF_DIR" && export > HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop" > > #! /usr/bin/env bash > > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the "License"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > # http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an "AS IS" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > > ### > ### Configure these environment variables to point to your local > installations. > ### > ### The functional tests require conditional values, so keep this style: > ### > ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0 > ### > ### > ### Note that the -Xmx -Xms settings below require substantial free memory: > ### you may want to use smaller values, especially when running everything > ### on a single machine. > ### > if [ -z "$HADOOP_HOME" ] > then > test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop > else > HADOOP_PREFIX="$HADOOP_HOME" > unset HADOOP_HOME > fi > # test -z "$HADOOP_CONF_DIR" && export > HADOOP_CONF_DIR="/usr/local/hadoop/conf" > # hadoop-2.0: > test -z "$HADOOP_CONF_DIR" && export > HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop" > > test -z "$JAVA_HOME" && export JAVA_HOME=/usr/lib/jvm/jdk1.7.0 > test -z "$ZOOKEEPER_HOME" && export > ZOOKEEPER_HOME=/usr/local/zookeeper > test -z "$ACCUMULO_LOG_DIR" && export > ACCUMULO_LOG_DIR=/usr/local/accumulo/logs > if [ -f /usr/local/accumulo/conf/accumulo.policy ] > then > POLICY="-Djava.security.manager > -Djava.security.policy=/usr/local/accumulo/conf/accumulo.policy" > fi > test -z "$ACCUMULO_TSERVER_OPTS" && export > ACCUMULO_TSERVER_OPTS="${POLICY} -Xmx1g -Xms1g -XX:NewSize=500m > -XX:MaxNewSize=500m " > test -z "$ACCUMULO_MASTER_OPTS" && export ACCUMULO_MASTER_OPTS="${POLICY} > -Xmx1g -Xms1g" > test -z "$ACCUMULO_MONITOR_OPTS" && export > ACCUMULO_MONITOR_OPTS="${POLICY} -Xmx1g -Xms256m" > test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx256m > -Xms256m" > test -z "$ACCUMULO_GENERAL_OPTS" && export > ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC > -XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true" > test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g > -Xms256m" > # what do when the JVM runs out of heap memory > export ACCUMULO_KILL_CMD='kill -9 %p' > > # Should the monitor bind to all network interfaces -- default: false > # export ACCUMULO_MONITOR_BIND_ALL="true" > > > On Tue, Mar 18, 2014 at 8:58 PM, Sean Busbey wrote: > >> >> On Mar 18, 2014 7:51 PM, "Benjamin Parrish" >> wrote: >> > >> > HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all >> ~/.bash_profile files as needed. >> > >> > >> >> Can you add to the gist the output of running >> >> $> find $HADOOP_CONF_DIR >> >> As the user who runs the tablet server on the same host you ran the >> classpath command on? >> >> -Sean >> > > > > -- > Benjamin D. Parrish > H: 540-597-7860 > --001a11c33676f01a0904f4f56bfa Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

I think by default zkCli.sh will just try to connect to loca= lhost. You can change this by providing the quorum string to the script wit= h the -server option.

On Mar 19, 2014 8:29 AM, "Benjamin Parrish&= quot; <benjamin.d.parris= h@gmail.com> wrote:
I adjusted accumulo-env.sh to have hard coded values = as seen below.

Are there any logs that could shed = some light on this issue?

If it also helps I am us= ing CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.

I also ran across this, that didn't look right...

Welcome to ZooKeeper!
2014-03-19 08:= 25:53,479 [myid:] - INFO =C2=A0[main-SendThread(localhost:2181):ClientCnxn$= SendThread@975] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attem= pt to authenticat
e using SASL (unknown error)
2014-03-19 08:25:53,483 [myid:]= - INFO =C2=A0[main-SendThread(localhost:2181):ClientCnxn$SendThread@852] -= Socket connection established to localhost/127.0.0.1:2181, initiating session
JLine support is enabled
[zk: localhost:2181(CONNECTING) 0] = 2014-03-19 08:25:53,523 [myid:] - INFO =C2=A0[main-SendThread(localhost:218= 1):ClientCnxn$SendThread@1235] - Session establishment complete on server l= ocalhost/127.0.
0.1:2181, sessionid =3D 0x144da4e00d90000, negotiated timeout =3D 3000= 0

should ZooKeeper try to hit localhost/127.0.0.1?

my zoo.cfg looks like this....
tickTime=3D2000
initLimit=3D10
syncLimit=3D5<= /div>
dataDir=3D/usr/local/zookeeper/data
clientPort=3D2181
server.1=3Dhadoop-node-1:2888:3888
server.2=3Dhadoop-nod= e-2:2888:3888
server.3=3Dhadoop-node-3:2888:3888
server.4=3Dhadoop-node-4:= 2888:3888
server.5=3Dhadoop-node-5:2888:3888

=
#! /usr/bin/env bash

# Licensed to the = Apache Software Foundation (ASF) under one or more
# contributor license agreements. =C2=A0See the NOTICE file distribute= d with
# this work for additional information regarding copyright ownership.<= /div>
# The ASF licenses this file to You under the Apache License, Ver= sion 2.0
# (the "License"); you may not use this file e= xcept in compliance with
# the License. =C2=A0You may obtain a copy of the License at
#
# =C2=A0 =C2=A0 http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software<= /div>
# distributed under the License is distributed on an "AS IS"= BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either ex= press or implied.
# See the License for the specific language gov= erning permissions and
# limitations under the License.

###
### Configure these environment variables to point to your local installa= tions.
###
### The functional tests require conditional= values, so keep this style:
###
### test -z "$JAVA_HOME" && export JAV= A_HOME=3D/usr/local/lib/jdk-1.6.0
###
###
###= Note that the -Xmx -Xms settings below require substantial free memory:
### you may want to use smaller values, especially when running everyt= hing
### on a single machine.
###
if [ -z &qu= ot;$HADOOP_HOME" ]
then
=C2=A0 =C2=A0test -z "= ;$HADOOP_PREFIX" =C2=A0 =C2=A0 =C2=A0&& export HADOOP_PREFIX= =3D/usr/local/hadoop
else
=C2=A0 =C2=A0HADOOP_PREFIX=3D"$HADOOP_HOME"
=C2=A0 =C2=A0unset HADOOP_HOME
fi
# test -z &q= uot;$HADOOP_CONF_DIR" =C2=A0 =C2=A0 =C2=A0 && export HADOOP_CO= NF_DIR=3D"/usr/local/hadoop/conf"
# hadoop-2.0:
test -z "$HADOOP_CONF_DIR" =C2=A0 = =C2=A0 && export HADOOP_CONF_DIR=3D"/usr/local/hadoop/etc/hado= op"

#! /usr/bin/env bash

=
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. =C2=A0See the NOTICE file distribute= d with
# this work for additional information regarding copyright= ownership.
# The ASF licenses this file to You under the Apache = License, Version 2.0
# (the "License"); you may not use this file except in compl= iance with
# the License. =C2=A0You may obtain a copy of the Lice= nse at
#
#
# Unless required by applicable law or agreed to in writin= g, software
# distributed under the License is distributed on an = "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF AN= Y KIND, either express or implied.
# See the License for the specific language governing permissions and<= /div>
# limitations under the License.

###
### Configure these environment variables to point to your local ins= tallations.
###
### The functional tests require conditional values, so = keep this style:
###
### test -z "$JAVA_HOME"= && export JAVA_HOME=3D/usr/local/lib/jdk-1.6.0
###
###
### Note that the -Xmx -Xms settings below require subst= antial free memory:
### you may want to use smaller values, espec= ially when running everything
### on a single machine.
###
if [ -z "$HADOOP_HOME" ]
then
= =C2=A0 =C2=A0test -z "$HADOOP_PREFIX" =C2=A0 =C2=A0 =C2=A0&&a= mp; export HADOOP_PREFIX=3D/usr/local/hadoop
else
=C2= =A0 =C2=A0HADOOP_PREFIX=3D"$HADOOP_HOME"
=C2=A0 =C2=A0unset HADOOP_HOME
fi
# test -z "= $HADOOP_CONF_DIR" =C2=A0 =C2=A0 =C2=A0 && export HADOOP_CONF_D= IR=3D"/usr/local/hadoop/conf"
# hadoop-2.0:
t= est -z "$HADOOP_CONF_DIR" =C2=A0 =C2=A0 && export HADOOP_= CONF_DIR=3D"/usr/local/hadoop/etc/hadoop"

test -z "$JAVA_HOME" =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 && export JAVA_HOME=3D/usr/lib/jvm/jdk1.7.0
=
test -z "$ZOOKEEPER_HOME" =C2=A0 =C2=A0 =C2=A0 =C2=A0&&a= mp; export ZOOKEEPER_HOME=3D/usr/local/zookeeper
test -z "$ACCUMULO_LOG_DIR" =C2=A0 =C2=A0 =C2=A0&& e= xport ACCUMULO_LOG_DIR=3D/usr/local/accumulo/logs
if [ -f /usr/lo= cal/accumulo/conf/accumulo.policy ]
then
=C2=A0 =C2=A0P= OLICY=3D"-Djava.security.manager -Djava.security.policy=3D/usr/local/a= ccumulo/conf/accumulo.policy"
fi
test -z "$ACCUMULO_TSERVER_OPTS" && exp= ort ACCUMULO_TSERVER_OPTS=3D"${POLICY} -Xmx1g -Xms1g -XX:NewSize=3D500= m -XX:MaxNewSize=3D500m "
test -z "$ACCUMULO_MASTER_OPT= S" =C2=A0&& export ACCUMULO_MASTER_OPTS=3D"${POLICY} -Xmx= 1g -Xms1g"
test -z "$ACCUMULO_MONITOR_OPTS" && export ACCUMULO_= MONITOR_OPTS=3D"${POLICY} -Xmx1g -Xms256m"
test -z &quo= t;$ACCUMULO_GC_OPTS" =C2=A0 =C2=A0 =C2=A0&& export ACCUMULO_GC= _OPTS=3D"-Xmx256m -Xms256m"
test -z "$ACCUMULO_GENERAL_OPTS" && export ACCUMULO_= GENERAL_OPTS=3D"-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFrac= tion=3D75 -Djava.net.preferIPv4Stack=3Dtrue"
test -z "$= ACCUMULO_OTHER_OPTS" =C2=A0 && export ACCUMULO_OTHER_OPTS=3D&q= uot;-Xmx1g -Xms256m"
# what do when the JVM runs out of heap memory
export ACCUMU= LO_KILL_CMD=3D'kill -9 %p'

# Should the mo= nitor bind to all network interfaces -- default: false
# export A= CCUMULO_MONITOR_BIND_ALL=3D"true"


On Tue,= Mar 18, 2014 at 8:58 PM, Sean Busbey <busbey+lists@cloudera.com> wrote:


On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <benjamin.d.parrish@gmail.c= om> wrote:
>
> HADOOP_CONF_DIR=3D/usr/local/hadoop/etc/hadoop is set in all ~/.bash_p= rofile files as needed.
>
>

Can you add to the gist the output of running

$> find $HADOOP_CONF_DIR

As the user who runs the tablet server on the same host you = ran the classpath command on?

-Sean




-- Benjamin D. Parrish
H: 540-597-7860
--001a11c33676f01a0904f4f56bfa--