cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shane Hansen <shanemhan...@gmail.com>
Subject Re: Better option to load data to cassandra
Date Thu, 13 Nov 2014 16:27:19 GMT
So sstableloader is a cpu efficient online method of loading data if you
already have sstables.

An option you may not have considered is just using batch inserts. It was a
surprise to me coming from another
database system, but C*'s primary use case is shoving data to an append
only log. Is there a faster way to write a chunk
of data other than as sequential writes?

The only caveat is that there seems to be more parsing overhead (source:
jvisualvm) when going
the batch writing route, which is why I made sure to mention sstable
loader's cpu efficiency.



On Thu, Nov 13, 2014 at 5:10 AM, Jonathan Lacefield <jlacefield@datastax.com
> wrote:

> Here's another post which is pretty comprehensive for this topic.
> http://informationsurvival.blogspot.com/2014/02/cassandra-cql3-integration.html
>
>
>
> [image: datastax_logo.png]
>
> Jonathan Lacefield
>
> Solution Architect | (404) 822 3487 | jlacefield@datastax.com
>
> [image: linkedin.png] <http://www.linkedin.com/in/jlacefield/> [image:
> facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
> <https://twitter.com/datastax> [image: g+.png]
> <https://plus.google.com/+Datastax/about>
> <http://feeds.feedburner.com/datastax> <https://github.com/datastax/>
>
> On Thu, Nov 13, 2014 at 3:16 AM, Robert Coli <rcoli@eventbrite.com> wrote:
>
>> On Wed, Nov 12, 2014 at 5:19 PM, cass savy <casssavy@gmail.com> wrote:
>>
>>> Sstableloader works well for large tables if you want to move data from
>>> Cassandra to Cassandra. This works if both C* are on the same version.
>>>
>>> Sstable2json and json2sstable is another alternative.
>>>
>> This post is getting a bit long in the tooth, but is still pretty
>> relevant :
>>
>> http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra
>>
>> =Rob
>> http://twitter.com/rcolidba
>>
>
>

Mime
View raw message