accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1859) Conditional Mutation with 1000 conditions is slow.
Date Thu, 14 Nov 2013 01:22:17 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822068#comment-13822068
] 

ASF subversion and git services commented on ACCUMULO-1859:
-----------------------------------------------------------

Commit c32fb19084688ff6c4e2c246c72b9e9783d84915 in branch refs/heads/master from [~keith_turner]
[ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=c32fb19 ]

ACCUMULO-1859 dramatically sped up iterating over Accumulo configs


> Conditional Mutation with 1000 conditions is slow.
> --------------------------------------------------
>
>                 Key: ACCUMULO-1859
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1859
>             Project: Accumulo
>          Issue Type: Bug
>          Components: client, tserver
>            Reporter: Keith Turner
>            Assignee: Keith Turner
>            Priority: Critical
>             Fix For: 1.6.0
>
>         Attachments: 0001-ACCUMULO-1859-experimental.patch, 0002-ACCUMULO-1859-experimental.patch,
CWPTest.java
>
>
> The random walk test for conditional mutations creates a conditional mutation  with 1000
conditions.  I noticed this was really slow.   
> I did some further testing using MiniAccumulo and was seeing times around 1300ms to 1400ms
for this operation (the conditions all checked for absence and all data for the tablet was
in memory).
> I traced the problem down to parsing the iterator config.  Iterating over the table config,
filtering non iterator props, and parsing was taking a little more than a 1ms.  I modifed
TableConfiguration to cache the iterator props and saw my test times drop to 120ms to 130ms.
 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message