cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andre Turgeon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CASSANDRA-10358) Allow CQLSSTableWriter.Builder to use custom AbstractSSTableSimpleWriter
Date Wed, 16 Sep 2015 19:04:46 GMT
Andre Turgeon created CASSANDRA-10358:
-----------------------------------------

             Summary: Allow CQLSSTableWriter.Builder to use custom AbstractSSTableSimpleWriter

                 Key: CASSANDRA-10358
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10358
             Project: Cassandra
          Issue Type: Improvement
          Components: Core
            Reporter: Andre Turgeon
            Priority: Minor
             Fix For: 2.0.x
         Attachments: patch.txt

I've created a patch for your consideration. 

This change to CQLSSTableWriter allows for a custom AbstractSSTableSimpleWriter to be specified.


I needed this for a bulkload process I wrote. I believe the change would be beneficial for
other people as well. 

Below are the reasons I needed a custom implementation of AbstractSSTableSimpleWriter:

1) The available implementations of AbstractSSTableSimpleWriter do not provide a way to specify
the filename (or rather revision) of the sstable. I needed to control the name because my
bulkload process write sstables in parallel (on multiple machines) and I wish to avoid name
collisions.

2) I discovered a problem with SSTableSimpleUnsortedWriter where it creates invalid level-compaction-style
sstables; It allows a partition to span 2 sstables which violates the "no overlap of token
ranges" constraint of level compaction.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message