Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A9A23E61B for ; Mon, 21 Jan 2013 14:39:45 +0000 (UTC) Received: (qmail 38648 invoked by uid 500); 21 Jan 2013 14:39:43 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 38490 invoked by uid 500); 21 Jan 2013 14:39:42 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 38474 invoked by uid 99); 21 Jan 2013 14:39:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jan 2013 14:39:42 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.223.177] (HELO mail-ie0-f177.google.com) (209.85.223.177) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Jan 2013 14:39:36 +0000 Received: by mail-ie0-f177.google.com with SMTP id k13so9933169iea.36 for ; Mon, 21 Jan 2013 06:39:13 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:x-originating-ip:in-reply-to:references :date:message-id:subject:from:to:content-type:x-gm-message-state; bh=MTBsv30JaDWHI14I6MqdtzWk4OIff65ZXVvyM8HWd/4=; b=fursASi0oQX2doRq6lJw1/MPWfgif7XORUErUoY150AuITNshSA+vNzV3VwBpz0Byb JEcwlVaybYq8MWCcnckyRfjfl6+eZZF0mPdr0wXbC/SPbpNDQ5OZ8usCZM4VRGWBzu7J mu2Qbc5eQCCipiK0mqIcdNtLdJD61nSoeHaNK6L2qhecEmze+VmkfO0WgOCcbjMIJ7xQ uCaapp8bkSwT3wOCWo/3z/U/SYlgopcYO/VJA25A4T+AMOVhz5lmpMtAXhgX0LbXP8TG o4WHPVyCe9nwcKwKmHlOeuOMyQ8ctWeDkfFICf/JvWN7OitnYYO3RFtSqkgBA0CDq3DL prrw== MIME-Version: 1.0 X-Received: by 10.50.216.200 with SMTP id os8mr9361409igc.74.1358779153809; Mon, 21 Jan 2013 06:39:13 -0800 (PST) Received: by 10.64.81.194 with HTTP; Mon, 21 Jan 2013 06:39:13 -0800 (PST) X-Originating-IP: [200.137.197.228] In-Reply-To: References: Date: Mon, 21 Jan 2013 12:39:13 -0200 Message-ID: Subject: Re: How to store large columns? From: =?ISO-8859-1?Q?S=E1vio_Teles?= To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=14dae93408dfca81b204d3cd6c20 X-Gm-Message-State: ALoCoQkrLpikl2V+hLDHK0fdWXgz6cWQ06P9I9SQ5Zyy7UdImI4R6Z7MptDGbxBO66J/xPQ9OpeX X-Virus-Checked: Checked by ClamAV on apache.org --14dae93408dfca81b204d3cd6c20 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Keith Wright. 2013/1/21 Keith Wright > This may be helpful: > https://github.com/Netflix/astyanax/wiki/Chunked-Object-Store > > From: Vegard Berget > Reply-To: "user@cassandra.apache.org" , Vegard > Berget > Date: Monday, January 21, 2013 8:35 AM > To: "user@cassandra.apache.org" > Subject: Re: How to store large columns? > > > > Hi, > > You could split it into multiple columns on the client side: > RowKeyData: Part1: [1mb], Part2: [1mb], Part3: [1mb]...PartN[1mb] > > Now you can use multiple get() in parallell to get the files back and the= n > join them back to one file. > > I _think_ maybe the new CQL3-protocol does not have the same limitation, > but I have never tried large columns there, so someone with more experien= ce > than me will have to confirm this. > > .vegard, > > > ----- Original Message ----- > From: > user@cassandra.apache.org > > To: > > Cc: > > Sent: > Mon, 21 Jan 2013 11:16:40 -0200 > Subject: > How to store large columns? > > > We wish to store a column in a row with size larger thanthrift_framed_tra= nsport_size_in_mb > . But, Thrift has a maximum frame size configured by > thrift_framed_transport_size_in_mb in cassandra.yaml. > so, How to store columns with size larger than > thrift_framed_transport_size_in_mb? Increasing this value does not solve = the > problem, since we have columns with varying sizes. > > -- > Atenciosamente, > S=E1vio S. Teles de Oliveira > voice: +55 62 9136 6996 > http://br.linkedin.com/in/savioteles > Mestrando em Ci=EAncias da Computa=E7=E3o - UFG > Arquiteto de Software > Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG > > --=20 Atenciosamente, S=E1vio S. Teles de Oliveira voice: +55 62 9136 6996 http://br.linkedin.com/in/savioteles Mestrando em Ci=EAncias da Computa=E7=E3o - UFG Arquiteto de Software Laboratory for Ubiquitous and Pervasive Applications (LUPA) - UFG --14dae93408dfca81b204d3cd6c20 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks Keith Wright.
=A0
2013/1/21 Kei= th Wright <kwright@nanigans.com>

From: Vegard Berget <post@fantasista.no>=
Reply-To: "user@cassandra.apache.org<= /a>" <user@cassandra.apache.org>, Vegard Berget <post@fantasista.no>
Date: Monday, January 21, 2013 8:3= 5 AM
To: "user@cassandra.apache.org" <= user@cassandra.apache.org>
Subject: Re: How to store large co= lumns?

=A0

Hi,

You could split it into multiple columns on the client = side: =A0
RowKeyData: Part1: [1mb], Part2: [1mb], Part3: [1mb]...PartN[1= mb]

Now you can use multiple get() in parallell to get the files back= and then join them back to one file.

I _think_ maybe the new CQL3-protocol does not have the same limitation,= but I have never tried large columns there, so someone with more experienc= e than me will have to confirm this.

.vegard,


----- Original Message -----
From:
user@cassandra.apache.org
To:
<user@cassandra.apache.org>
Cc:

Sen= t:
Mon, 21 Jan 2013 11:16:40 -0200
Subject:=
How to store large columns?


We wis= h to store a column in a row with si= ze larger than thrift_framed_transport_size_in_mb= . But, Thrift has a maximum frame size configure= d by thrift_framed_transport_size_in_mb in cassandra.yaml.
so, How to store = columns with size larger than thrift_framed_transpo= rt_size_in_mb? Increasin= g this value does not solve the prob= lem, since we have columns wi= th varying sizes.

--
Atenciosamente,
S=E1vio S. Teles de O= liveira
voice: +55 62 9136 6996
http://br.linkedin.co= m/in/savioteles
Mestrando em Ci=EAncias da Computa=E7=E3o - UFG
Arquiteto de Software
Laboratory for Ubiquitous and Pervasive Applications (LUP= A) - UFG



--
Atenciosamente,
S=E1vio S. Teles de Oliveira
voice: +55 62 9136= 6996
http://br.linkedin.com/in/savioteles
Mestrando em Ci=EAncias da Computa=E7=E3o - UFG
Arquiteto de Software
Laboratory for Ubiquitous and Pervasive Applications (LUP= A) - UFG
 --14dae93408dfca81b204d3cd6c20--