cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vadim Chekan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-5894) CQL-aware SSTableWriter
Date Tue, 15 Oct 2013 23:10:42 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795782#comment-13795782
] 

Vadim Chekan commented on CASSANDRA-5894:
-----------------------------------------

Great! I successfully did the following: generated 10mln rows on cassandra (current from the
github + the patch); Win64; scala, copied sstables to Linux/cassandra-2.0.1 and imported with
sstableloader. Generating performance was roughly 1.4x of the bulk insert via SQL3. Insert
was <1minute, which is instant in comparison to generating.

Not any kind of problem, but just a side note. When generating, I tried to raise withBufferSizeInMB
on 16Gb Ram box and -Xmx9g option but could not go higher than 750Mb buffer, because GC shots
itself in the head.

> CQL-aware SSTableWriter
> -----------------------
>
>                 Key: CASSANDRA-5894
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5894
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Tools
>            Reporter: Jonathan Ellis
>            Assignee: Sylvain Lebresne
>            Priority: Minor
>             Fix For: 2.0.2
>
>         Attachments: 5894.txt, 5894-v2.txt
>
>
> SSTableSimple[Un]SortedWriter requires defining raw comparators and inserting raw data
cells.  We should create a CQL-aware alternative.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message