accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ACCUMULO-2834) Immediately re-queue files which have more data to replicate
Date Thu, 22 May 2014 22:39:01 GMT
Josh Elser created ACCUMULO-2834:
------------------------------------

             Summary: Immediately re-queue files which have more data to replicate
                 Key: ACCUMULO-2834
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2834
             Project: Accumulo
          Issue Type: Sub-task
          Components: replication
            Reporter: Josh Elser
            Assignee: Josh Elser
             Fix For: 1.7.0


Noticed that during high ingest load, there's a bit of downtime between iterations as, after
the batch size is reached, the tserver records the progress it made, and it waits for the
master to re-queue the file.

This is a bit silly as the tserver could just continue to replicate from where it left off
to reduce the latency in waiting to replicate the file. The remote side will still buffer,
so we shouldn't be oversaturating the remote.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message