accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Billie Rinaldi <billie.rina...@gmail.com>
Subject Re: Multiple talbet servers on the same host
Date Thu, 10 Dec 2015 12:33:47 GMT
Ah, that's my fault. I forgot another change you should make. In
conf2/accumulo-env.sh, change ACCUMULO_LOG_DIR and ACCUMULO_PID_DIR and see
if that helps.
On Dec 10, 2015 3:29 AM, "Sven Hodapp" <sven.hodapp@scai.fraunhofer.de>
wrote:

Hi Billie,

thanks for your reply! I've created a conf2 dir with tserver.port.client
set to another port. I've also made shure, that in the environment
ACCUMULO_CONF_DIR is set with conf2.
But it's said "tablet server already running".

I'm using Accumulo 1.7.0, currently on a single node. But because the
machine is a big one (48 cores, 256 GB RAM) I'd like to test if multiple
tservers on the same machine bring some benefit.
Currently the single tablet server yields about 100k writes per second. Or
may we have a disk-bottleneck?

Regards,
Sven

--
Sven Hodapp, M.Sc.,
Fraunhofer Institute for Algorithms and Scientific Computing SCAI,
Department of Bioinformatics
Schloss Birlinghoven, 53754 Sankt Augustin, Germany
sven.hodapp@scai.fraunhofer.de
www.scai.fraunhofer.de

----- Urspr√ľngliche Mail -----
> Von: "Billie Rinaldi" <billie.rinaldi@gmail.com>
> An: "user" <user@accumulo.apache.org>
> Gesendet: Mittwoch, 9. Dezember 2015 18:40:25
> Betreff: Re: Multiple talbet servers on the same host

> Hi Sven,
>
> The tablet server port is configured in the accumulo-site.xml file.  Ports
> should not appear in the slaves file.  Thus, you would need a separate
> configuration directory for Accumulo to be able to start up a second set
of
> tablet servers on a different port.  Let's say you copied your existing
> conf directory to a directory named conf2, with the tserver.port.client
> property set to a new value in the conf2/accumulo-site.xml file, and
pushed
> this conf2 directory out to all your nodes.  Then you should be able to
> start the second set of tablet servers by running
> ACCUMULO_CONF_DIR=/path/to/conf2 $ACCUMULO_HOME/bin/tup.sh from one of the
> nodes.
>
> That's how you could do this, but I'd encourage you to evaluate whether
you
> actually need to do this based on your workload, hardware, version of
> Accumulo, etc.
>
> Billie
>
> On Wed, Dec 9, 2015 at 8:30 AM, Sven Hodapp <
sven.hodapp@scai.fraunhofer.de>
> wrote:
>
>> Hi there,
>>
>> I've read in the Accumulo Book (p. 496) that it should be possible to
>> start on a (fat) machine multiple tablet servers to scale (also)
>> vertically. Sadly it's not described how to do it. Also I didn't find
>> anything about this issue in the official documentation.
>>
>> I thought it must be configured in ACCUMULO_HOME/conf/slaves.
>> So I've added here the same IP with distinct ports multiple times ... in
>> my naive thinking.
>> But *no* additional tablet servers are started.
>>
>> Or I am completely wrong here?
>>
>> Regards,
>> Sven
>>
>> --
>> Sven Hodapp, M.Sc.,
>> Fraunhofer Institute for Algorithms and Scientific Computing SCAI,
>> Department of Bioinformatics
>> Schloss Birlinghoven, 53754 Sankt Augustin, Germany
>> sven.hodapp@scai.fraunhofer.de
>> www.scai.fraunhofer.de

Mime
View raw message