Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Received-SPF: pass (athena.apache.org: domain of eric.newton@gmail.com
 designates 209.85.212.51 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAJbywz=uBSTrW9e554rM08AzW4-KO1pEO=tKwysWyupu9_gJSw@mail.gmail.com>
References: 
 <CAJbywz=uBSTrW9e554rM08AzW4-KO1pEO=tKwysWyupu9_gJSw@mail.gmail.com>
Date: Wed, 1 May 2013 16:13:00 -0400
Message-ID: 
 <CADxc9B=Q4PbgjuNKDwOKfysAftsYTB-g2cxNpbEvnmhXgbux-g@mail.gmail.com>
Subject: Re: Newbie question: where do the services live?
From: Eric Newton <eric.newton@gmail.com>
To: "user@accumulo.apache.org" <user@accumulo.apache.org>
Content-Type: multipart/alternative; boundary=20cf307d07509c400704dbadbeef

--20cf307d07509c400704dbadbeef
Content-Type: text/plain; charset=ISO-8859-1

On all but the largest clusters, the computing needs of the
master/gc/monitor/tracer can all run on one node and can be co-located with
a zookeeper server.

Strictly speaking, you don't need a tracer.  Unless you are running a very
large cluster, one tracer will be enough.

The tracer can be used to identify components that are performing slowly,
so it needs to run all the time.

-Eric


On Wed, May 1, 2013 at 3:57 PM, Aaron G <aarongmldt@gmail.com> wrote:

> Generic/best practices question about the 6 services:  master, gc,
> tserver, logger, monitor, tracer
>
> For this example/discussion let's say I have a cluster, with 10 nodes
> (n01-n10)...3 of the nodes running zookeeper
>
> n01:  NameNode, zooKeeper
> n02:  SecondaryNameNode, zooKeeper
> n03:  JobTracker, zooKeeper
> n04:  empty (for now)
>
> Let's label these storage/compute nodes:
> n05-n10:  dataNode, taskTracker
>
> So, how i thought this could be setup for Accumulo services:
>
> n04:  master & gc
> n05-n10:  each runs a tserver & logger
>
> I think my main questions revolve around the monitor & tracer services and
> where they run:
>
> 1.  Does those need to run on every "compute node"?
> 2.  Do you only need one running instance of monitor?  Perhaps on the n04?
>  Or does it need to run on every tserver as well?
> 3.  Do you only need the tracer service running on compute nodes?  Or
> everywhere (master & gc included)?  Do you only need the tracer for the
> purpose of development of Iterators, Scanners, Writers?  They primarily
> there to help with that activity?  Or are they useful to have running "all
> the time?"
>
> Thanks in advance,
> Aaron
>

--20cf307d07509c400704dbadbeef
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">On all but the largest clusters, the computing needs of th=
e master/gc/monitor/tracer can all run on one node and can be co-located wi=
th a zookeeper server.<div><br></div><div>Strictly speaking, you don&#39;t =
need a tracer. =A0Unless you are running a very large cluster, one tracer w=
ill be enough.</div>
<div><br></div><div style>The tracer can be used to identify components tha=
t are performing slowly, so it needs to run all the time.</div><div><div><d=
iv><br></div><div style>-Eric</div></div></div></div><div class=3D"gmail_ex=
tra">
<br><br><div class=3D"gmail_quote">On Wed, May 1, 2013 at 3:57 PM, Aaron G =
<span dir=3D"ltr">&lt;<a href=3D"mailto:aarongmldt@gmail.com" target=3D"_bl=
ank">aarongmldt@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gma=
il_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-lef=
t:1ex">
<div dir=3D"ltr">Generic/best practices question about the 6 services: =A0m=
aster, gc, tserver, logger, monitor, tracer<div><br></div><div>For this exa=
mple/discussion let&#39;s say I have a cluster, with 10 nodes (n01-n10)...3=
 of the nodes running zookeeper</div>

<div><br></div><div>n01: =A0NameNode, zooKeeper</div><div>n02: =A0Secondary=
NameNode, zooKeeper</div><div>n03: =A0JobTracker, zooKeeper</div><div>n04: =
=A0empty (for now)<br></div><div><br></div>
<div>Let&#39;s label these storage/compute nodes:</div><div>n05-n10: =A0dat=
aNode, taskTracker</div><div><br></div><div>So, how i thought this could be=
 setup for Accumulo services:<br></div><div><br></div><div>
n04: =A0master &amp; gc</div><div>n05-n10: =A0each runs a tserver &amp; log=
ger</div><div><br></div><div>I think my main questions revolve around the m=
onitor &amp; tracer services and where they run: =A0</div><div>
<br></div><div>1. =A0Does those need to run on every &quot;compute node&quo=
t;?=A0</div><div>2. =A0Do you only need one running instance of monitor? =
=A0Perhaps on the n04? =A0Or does it need to run on every tserver as well?<=
/div>
<div>3. =A0Do you only need the tracer service running on compute nodes? =
=A0Or everywhere (master &amp; gc included)? =A0Do you only need the tracer=
 for the purpose of development of Iterators, Scanners, Writers? =A0They pr=
imarily there to help with that activity? =A0Or are they useful to have run=
ning &quot;all the time?&quot; =A0</div>

<div><br></div><div>Thanks in advance,</div><div>Aaron</div></div>
</blockquote></div><br></div>

--20cf307d07509c400704dbadbeef--