cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From DuyHai Doan <doanduy...@gmail.com>
Subject Re: Using Cassandra as an object store
Date Fri, 19 Apr 2019 08:04:32 GMT
Idea:

To guarantee data integrity, you can store an MD5 of all chunks data as
static column in the partition that contains the chunks

On Fri, Apr 19, 2019 at 9:18 AM cclive1601你 <cclive1601@gmail.com> wrote:

> we have use cassandra as object store for some years, you can just split
> the object into some small pieces. object got a pk, then the some small
> pieces got some pks ,object's pk and pieces's pk can be store in meta table
> in cassandra, and small pieces's pk and some pieces store in data table.
> we store videos ,picture and other no structure data.
>
> Gene <gh5046@gmail.com> 于2019年4月19日周五 下午1:25写道:
>
>> Howdy
>>
>> I'm looking at the possibility of using cassandra as an object store to
>> offload image/blob data from an Oracle database.  I've seen mentions of it
>> being used as an object store in a large scale fashion, like with Walmart:
>>
>>
>> https://medium.com/walmartlabs/building-object-store-storing-images-in-cassandra-walmart-scale-a6b9c02af593
>>
>> However I have found little on small scale setups and if it's even worth
>> using Cassandra in place of something else that's meant to be used for
>> object storage, like Ceph.
>>
>> Additionally, I've read that cassandra struggles with storing objects
>> 10MB or larger and it's recommended to break objects up into smaller
>> chunks, which either requires some kind of middleware between our
>> application and cassandra, or it would require our application to split
>> objects into smaller chunks and recombine them as needed.
>>
>> I've looked into pithos and astyanax, but those are both no longer
>> developed and I'm not seeing anything that might replace them in the long
>> term.
>>
>> https://github.com/exoscale/pithos
>> https://github.com/Netflix/astyanax
>>
>> Any helpful information or advice would be greatly appreciated.
>>
>> Thanks in advance.
>>
>> -Gene
>>
>
>
> --
> you are the apple of my eye !
>

Mime
View raw message