incubator-cassandra-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Nine <t...@spidertracks.co.nz>
Subject Batch mutation dropping String bytes
Date Mon, 28 Jun 2010 07:29:47 GMT
Hi all,
  I thought the dev list would be more appropriate for this discussion.  I'm
having issues inserting Numeric Range keys in Lucandra and I've determined
the issue (I think).  Numeric keys are encoded with a trie data structure.
The bits of the underlying values are packed 7 bits at a time into a UTF-8
character.  Bits are then shifted from the right LSB, and the number of bits
shifted is put as the first byte.  This gives an array of bytes with the
characters actually containing bit values of the underlying long data type.
 Here is the source that performs the shift operations.

http://svn.apache.org/viewvc/lucene/java/tags/lucene_3_0_2/src/java/org/apache/lucene/util/NumericUtils.java?revision=955593&view=markup

I've created a JIRA issue with a test case that displays the error.  I have
a test that demonstrates the input in both direct write mode and
batch_mutation.  I can only reproduce the bytes getting dropped via the
batch mutation operations.  My second test that performs direct writes
correctly writes and retrieves the values.

http://issues.apache.org/jira/browse/CASSANDRA-1235


Where would I begin looking at the fix for this? Its unfortunately killing
our productivity, and doing single write inserts as a workaround is woefully
inefficient for the amount of data we need to write.

Thanks,
Todd

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message