accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ACCUMULO-1962) Improve batch scanner throughput in failure case
Date Sat, 04 Apr 2015 02:40:35 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Elser updated ACCUMULO-1962:
---------------------------------
    Fix Version/s:     (was: 1.7.0)
                   1.8.0

> Improve batch scanner throughput in failure case
> ------------------------------------------------
>
>                 Key: ACCUMULO-1962
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1962
>             Project: Accumulo
>          Issue Type: Improvement
>            Reporter: Keith Turner
>             Fix For: 1.8.0
>
>
> The batch scanner currently does the following.
>  # bin ranges to tablets servers and tabelts
>  # if any ranges could not be binned (e.g. a  tablet had no location) goto 1
>  # queue up work for tablet servers on a thread pool
>  # wait for thread pool to complete all work
>  # if there were any failures goto 1
> In the face of failures (tablets not assigned because of migration, tablet servers dying)
it would be better if the batch scanner worked on what it could and immediately requeued failures
for processing immediately.   The ConditionalWriter and BatchWriter have failure queues and
increase the retry time if something keeps failing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message