accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2789) Add a system stress test based on key/cell/row size
Date Thu, 22 May 2014 11:35:01 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005833#comment-14005833
] 

ASF subversion and git services commented on ACCUMULO-2789:
-----------------------------------------------------------

Commit 74acc30cafb8be0ee5c7cc457c5e09f0ea56a993 in accumulo's branch refs/heads/1.6.1-SNAPSHOT
from Bill Slacum
[ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=74acc30 ]

ACCUMULO-2789 Add stress test with variable cell sizes

Added a test that users can run to stress their instances. They can supply
variable cell sizes (currently row, column family and column qualifier are
supported), and the write clients will generate random data within those size
constraints. Users can also scan random tablets to add futher load onto the
system. A variable number of write and reader clients can be executed to run
the test under a mixed workload.

This test is an acid test-- it is used to verify that an instance can handle
the workload provided by it. It doesn't assert an actual state of the system,
beyond reporting what errors the write and scan clients will see.

See the included package-info.java and/or README.md files for more information.


> Add a system stress test based on key/cell/row size
> ---------------------------------------------------
>
>                 Key: ACCUMULO-2789
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2789
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: test
>            Reporter: Sean Busbey
>            Assignee: William Slacum
>            Priority: Minor
>             Fix For: 1.5.2, 1.6.1, 1.7.0
>
>
> Add a system test that allows stress testing an Accumulo instance in the presence of
large cells and rows.
> The test should run a configurable number of ingest and reading clients and allow setting:
> * configurable range of overall key size
> * configurable range of key component sizes
> * configurable value size
> * configurable number of cells per row
> * optional use of isolation on server and/or client
> This kind of test would help us preemptively find issues like ACCUMULO-2671, ACCUMULO-201,
and the tserver memory crashes observed with some large mutation sizes while working on YCSB
support for Accumulo.
> It will also help us provide test examples of supporting large cardinality on rowids,
column families, and visibilities.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message