accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Newton (JIRA)" <>
Subject [jira] [Created] (ACCUMULO-2556) use asynchronous calls to scale BatchReader client calls
Date Wed, 26 Mar 2014 15:05:15 GMT
Eric Newton created ACCUMULO-2556:

             Summary: use asynchronous calls to scale BatchReader client calls
                 Key: ACCUMULO-2556
             Project: Accumulo
          Issue Type: Bug
          Components: client
            Reporter: Eric Newton

Presently, the BatchReader uses a thread-pool to make synchronous calls to tablet servers
to fetch data.  That limits the number of tablet servers that can be doing queries in parallel.
 On very large clusters, clients may not initiate queries to all of the servers until some
queries finish.  It is not practical to create thousands of threads just to initiate queries.

Alternatively, asynchronous calls can efficiently initiate queries an wait for responses,
without using threads just to wait on responses.

This message was sent by Atlassian JIRA

View raw message