cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcus Eriksson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-8429) Stress on trunk fails mixed workload on missing keys
Date Mon, 08 Dec 2014 21:02:12 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238459#comment-14238459
] 

Marcus Eriksson commented on CASSANDRA-8429:
--------------------------------------------

so, SSTW.openEarly() does not actually make all keys written to the writer available for reading,
instead it finds the last key that is actually readable and sets that as SSTablereader.last,
which was fine until CASSANDRA-8124 because we made actual files of the results before the
compaction was done. We still only move starts to reader.last, but since we do that several
times we create gaps in the range, making some keys unreadable until the compaction is done.

We need to properly close the early opened file, but still keep it as a -tmp file

> Stress on trunk fails mixed workload on missing keys
> ----------------------------------------------------
>
>                 Key: CASSANDRA-8429
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8429
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Ubuntu 14.04
>            Reporter: Ariel Weisberg
>            Assignee: Marcus Eriksson
>         Attachments: cluster.conf, run_stress.sh
>
>
> Starts as part of merge commit 25be46497a8df46f05ffa102bc645bfd684ea48a
> Stress will say that a key wasn't validated because it isn't returned even though it's
loaded. The key will eventually appear and can be queried using cqlsh.
> Reproduce with
> #!/bin/sh
> rm /tmp/fark
> ROWCOUNT=10000000
> SCHEMA='-col n=fixed(1) -schema compaction(strategy=LeveledCompactionStrategy) compression=LZ4Compressor'
> ./cassandra-stress write n=$ROWCOUNT -node xh61 -pop seq=1..$ROWCOUNT no-wrap -rate threads=25
$SCHEMA
> ./cassandra-stress mixed "ratio(read=2)" n=100000000 -node xh61 -pop "dist=extreme(1..$ROWCOUNT,0.6)"
-rate threads=25 $SCHEMA



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message