accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denis Petrov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-3471) Adding a new tserver puts some tables offline for few minutes
Date Wed, 14 Jan 2015 06:31:34 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276553#comment-14276553
] 

Denis Petrov commented on ACCUMULO-3471:
----------------------------------------

You could try
log4j.appender.A2.Threshold=TRACE
log4j.logger.org.apache.accumulo.core.client.impl.TabletServerBatchWriter=TRACE

====
2015-01-14 06:21:30,212 [impl.TabletServerBatchWriter] TRACE: sent 1 mutations to c10:9997
in 0.37 secs (2.73 mutations/sec) with 0 failures
2015-01-14 06:21:30,557 [impl.TabletServerBatchWriter] TRACE: sent 1 mutations to c10:9997
in 0.33 secs (3.06 mutations/sec) with 0 failures
2015-01-14 06:21:30,801 [impl.TabletServerBatchWriter] TRACE: sent 1 mutations to c10:9997
in 0.23 secs (4.33 mutations/sec) with 0 failures
2015-01-14 06:21:31,097 [impl.TabletServerBatchWriter] TRACE: sent 1 mutations to c10:9997
in 0.26 secs (3.89 mutations/sec) with 0 failures
2015-01-14 06:21:31,499 [impl.TabletServerBatchWriter] TRACE: sent 1 mutations to c10:9997
in 0.39 secs (2.56 mutations/sec) with 0 failures
====

It seems that updating metatable one row a time is slow.


> Adding a new tserver puts some tables offline for few minutes
> -------------------------------------------------------------
>
>                 Key: ACCUMULO-3471
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3471
>             Project: Accumulo
>          Issue Type: Bug
>          Components: tserver
>    Affects Versions: 1.6.1
>         Environment: Ubuntu 12.04
>            Reporter: Denis Petrov
>             Fix For: 1.6.2, 1.7.0
>
>         Attachments: ACCUMULO-3471-balance-test.patch
>
>
> I run an Accumulo cluster with 15 tservers with about 6000 tablets on each (disks are
quite slow - each node has 2*4Tb SATA)
> When a new tserver added to the cluster, the rebalancing procedure starts.
> During this procedure some tablets are offline and unreachable during 5-10 minutes.
> It is visible in http://monitor:50095/tables and by timeouts on client side.
> The rebalancing caused by killing a tserver converges much faster then rebalancing caused
by adding a tserver.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message