cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From DuyHai Doan <doanduy...@gmail.com>
Subject Re: Moving Away from Compact Storage
Date Tue, 02 Feb 2016 18:58:02 GMT
So there is no "static" (in the sense of CQL static) column in your legacy
table.

Just define a Scala case class to match this table and use Spark to dump
the content to a new non compact CQL table

On Tue, Feb 2, 2016 at 7:55 PM, Anuj Wadehra <anujw_2003@yahoo.co.in> wrote:

> Our old table looks like this from cqlsh:
>
> CREATE TABLE table table1 (
>   key text,
>   "Col1" blob,
>   "Col2" text,
>   "Col3" text,
>   "Col4" text,
>   PRIMARY KEY (key)
> ) WITH COMPACT STORAGE AND …
>
> And it will have some dynamic text data which we are planning to add in
> collections..
>
> Please let me know if you need more details..
>
>
> Thanks
> Anuj
> Sent from Yahoo Mail on Android
> <https://overview.mail.yahoo.com/mobile/?.src=Android>
>
> On Wed, 3 Feb, 2016 at 12:14 am, DuyHai Doan
> <doanduyhai@gmail.com> wrote:
> Can you give the CREATE TABLE script for you old compact storage table ?
> Or at least the cassandra-client creation script
>
> On Tue, Feb 2, 2016 at 3:48 PM, Anuj Wadehra <anujw_2003@yahoo.co.in>
> wrote:
>
>> Thanks DuyHai !! We were also thinking to do it the "Spark" way but I was
>> not sure that its would be so simple :)
>>
>> We have a compact storage cf with each row having some data in staticly
>> defined columns while other data in dynamic columns. Is the approach
>> mentioned in link adaptable to the scenario where we want to migrate the
>> existing data to a Non-Compact CF with static columns and collections ?
>>
>> Thanks
>> Anuj
>>
>> --------------------------------------------
>> On Tue, 2/2/16, DuyHai Doan <doanduyhai@gmail.com> wrote:
>>
>>  Subject: Re: Moving Away from Compact Storage
>>  To: user@cassandra.apache.org
>>  Date: Tuesday, 2 February, 2016, 12:57 AM
>>
>>  Use Apache
>>  Spark to parallelize the data migration. Look at this piece
>>  of code
>> https://github.com/doanduyhai/Cassandra-Spark-Demo/blob/master/src/main/scala/usecases/MigrateAlbumsData.scala#L58-L60
>>  If your source and target tables
>>  have the SAME structure (except for the COMPACT STORAGE
>>  clause), migration with Spark is a 2 lines of
>>  code
>>  On Mon, Feb 1, 2016 at 8:14
>>  PM, Anuj Wadehra <anujw_2003@yahoo.co.in>
>>  wrote:
>>  Hi
>>  Whats the fastest and reliable way
>>  to migrate data from a Compact Storage table to Non-Compact
>>  storage table?
>>  I was not
>>  able to find any command for dropping the compact storage
>>  directive..so I think migrating data is the only way...any
>>  suggestions?
>>  ThanksAnuj
>>
>>
>>
>

Mime
View raw message