Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=wWwl19uvDOqcf655bPk+07qLrNvGIO+Oq2XBAJ/ARuakIdNPafpxzlN7+38ltZS4RNFXgUqpsDpIoskMXq60CzcLZdTsa4jn1ktwLFi+1Qn428NyLLeJG3C3ecLXHULod/bwsQnzYIvfEl1NecBGwcO8wCobb86FhGS8tsW0nOA=;
Message-ID: <660743.32612.qm@web51103.mail.re2.yahoo.com>
References: <330852.66053.qm@web51103.mail.re2.yahoo.com>
 <AANLkTimytmMjoaPu_85tQuQjFt9BK1zPNPyfk=JETvX1@mail.gmail.com>
Date: Tue, 30 Nov 2010 06:18:51 -0800 (PST)
From: E S <tr1sklion@yahoo.com>
Subject: Re: Achieving isolation on single row modifications with batch_mutate
To: user@cassandra.apache.org
In-Reply-To: <AANLkTimytmMjoaPu_85tQuQjFt9BK1zPNPyfk=JETvX1@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-362242932-1291126731=:32612"

--0-362242932-1291126731=:32612
Content-Type: text/plain; charset=us-ascii

I'm chunking up a larger blob.  Basically the size of each row can vary 
(averages around 500K - 1MB), with some outliers in the 50 MB range.   However, 
when I do an update, I can usually just read/update a portion of that blob.  A 
lot of my read operations can also work on a smaller chunk.  The number of 
columns is going to depend on the size of the blob itself.  I'm also considering 
using supercolumns to have higher save granularity.

My biggest problem is that I will have to update these rows a lot (several times 
a day) and often very quickly (process 15 thousand in 2-3 minutes).  While I 
think I could probably scale up with a lot of hardware to meet that load, it 
seems like I'm doing much much more work than I need to (processing 15 GB of 
data in 2-3 minutes as opposes to 100 MB).  I also worry about handling our 
future data size needs.

I can split the blob up without a lot of extra complexity but am worried about 
how to have readers read a non-corrupted version of the object, since sometimes 
I'll have to update multiple chunks as one unit.


________________________________
From: Tyler Hobbs <tyler@riptano.com>
To: user@cassandra.apache.org
Sent: Tue, November 30, 2010 12:57:07 AM
Subject: Re: Achieving isolation on single row modifications with batch_mutate

In this case, it sounds like you should combine columns A and B if you
are writing them both at the same time, reading them both at the same
time, and need them to be consistent.

Obviously, you're probably dealing with more than two columns here, but
there's generally not any value in splitting something into multiple columns
if you're always writing and reading all of them at the same time.

Or are you talking about chunking huge blobs across a row?

- Tyler


On Sat, Nov 27, 2010 at 10:12 AM, E S <tr1sklion@yahoo.com> wrote:

I'm trying to figure out the best way to achieve single row modification
>isolation for readers.
>
>As an example, I have 2 rows (1,2) with 2 columns (a,b).  If I modify both 
rows,
>I don't care if the user sees the write operations completed on 1 and not on 2
>for a short time period (seconds).  I also don't care if when reading row 1 the
>user gets the new value, and then on a re-read gets the old value (within a few
>seconds).  Because of this, I have been planning on using a consistency level 
of
>one.
>
>However, if I modify both columns A,B on a single row, I need both changes on
>the row to be visible/invisible atomically.  It doesn't matter if they both
>become visible and then both invisible as the data propagates across nodes, but
>a half-completed state on an initial read will basically be returning corrupt
>data given my apps consistency requirements.  My understanding from the FAQ 
that
>this single row multicolumn change provides no read isolation, so I will have
>this problem.  Is this correct?  If so:
>
>Question 1:  Is there a way to get this type of isolation without using a
>distributed locking mechanism like cages?
>
>Question 2:  Are there any plans to implement this type of isolation within
>Cassandra?
>
>Question 3:  If I went with a distributed locking mechanism, what consistency
>level would I need to use with Cassandra?  Could I still get away with a
>consistency level of one?  It seems that if the initial write is done in a
>non-isolated way, but if cross-node row synchronizations are done all or
>nothing, I could still use one.
>
>Question 4:  Does anyone know of a good c# alternative to cages/zookeeper?
>
>Thanks for any help with this!
>
>
>
>
>


--0-362242932-1291126731=:32612
Content-Type: text/html; charset=us-ascii

<html><head><style type="text/css"><!-- DIV {margin:0px;} --></style></head><body><div style="font-family:times new roman,new york,times,serif;font-size:12pt"><div>I'm chunking up a larger blob.&nbsp; Basically the size of each row can vary (averages around 500K - 1MB), with some outliers in the 50 MB range. &nbsp; However, when I do an update, I can usually just read/update a portion of that blob.&nbsp; A lot of my read operations can also work on a smaller chunk.&nbsp; The number of columns is going to depend on the size of the blob itself.&nbsp; I'm also considering using supercolumns to have higher save granularity.<br><br>My biggest problem is that I will have to update these rows a lot (several times a day) and often very quickly (process 15 thousand in 2-3 minutes).&nbsp; While I think I could probably scale up with a lot of hardware to meet that load, it seems like I'm doing much much more work than I need to (processing 15 GB of data in 2-3
 minutes as opposes to 100 MB).&nbsp; I also worry about handling our future data size needs.<br><br>I can split the blob up without a lot of extra complexity but am worried about how to have readers read a non-corrupted version of the object, since sometimes I'll have to update multiple chunks as one unit.<br></div><div style="font-family: times new roman,new york,times,serif; font-size: 12pt;"><br><div style="font-family: times new roman,new york,times,serif; font-size: 12pt;"><font face="Tahoma" size="2"><hr size="1"><b><span style="font-weight: bold;">From:</span></b> Tyler Hobbs &lt;tyler@riptano.com&gt;<br><b><span style="font-weight: bold;">To:</span></b> user@cassandra.apache.org<br><b><span style="font-weight: bold;">Sent:</span></b> Tue, November 30, 2010 12:57:07 AM<br><b><span style="font-weight: bold;">Subject:</span></b> Re: Achieving isolation on single row modifications with batch_mutate<br></font><br>
In this case, it sounds like you should combine columns A and B if you<br>are writing them both at the same time, reading them both at the same<br>time, and need them to be consistent.<br><br>Obviously, you're probably dealing with more than two columns here, but<br>
there's generally not any value in splitting something into multiple columns<br>if you're always writing and reading all of them at the same time.<br><br>Or are you talking about chunking huge blobs across a row?<br>
<br>- Tyler<br><br><div class="gmail_quote">On Sat, Nov 27, 2010 at 10:12 AM, E S <span dir="ltr">&lt;<a rel="nofollow" ymailto="mailto:tr1sklion@yahoo.com" target="_blank" href="mailto:tr1sklion@yahoo.com">tr1sklion@yahoo.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
I'm trying to figure out the best way to achieve single row modification<br>
isolation for readers.<br>
<br>
As an example, I have 2 rows (1,2) with 2 columns (a,b). &nbsp;If I modify both rows,<br>
I don't care if the user sees the write operations completed on 1 and not on 2<br>
for a short time period (seconds). &nbsp;I also don't care if when reading row 1 the<br>
user gets the new value, and then on a re-read gets the old value (within a few<br>
seconds). &nbsp;Because of this, I have been planning on using a consistency level of<br>
one.<br>
<br>
However, if I modify both columns A,B on a single row, I need both changes on<br>
the row to be visible/invisible atomically. &nbsp;It doesn't matter if they both<br>
become visible and then both invisible as the data propagates across nodes, but<br>
a half-completed state on an initial read will basically be returning corrupt<br>
data given my apps consistency requirements. &nbsp;My understanding from the FAQ that<br>
this single row multicolumn change provides no read isolation, so I will have<br>
this problem. &nbsp;Is this correct? &nbsp;If so:<br>
<br>
Question 1: &nbsp;Is there a way to get this type of isolation without using a<br>
distributed locking mechanism like cages?<br>
<br>
Question 2: &nbsp;Are there any plans to implement this type of isolation within<br>
Cassandra?<br>
<br>
Question 3: &nbsp;If I went with a distributed locking mechanism, what consistency<br>
level would I need to use with Cassandra? &nbsp;Could I still get away with a<br>
consistency level of one? &nbsp;It seems that if the initial write is done in a<br>
non-isolated way, but if cross-node row synchronizations are done all or<br>
nothing, I could still use one.<br>
<br>
Question 4: &nbsp;Does anyone know of a good c# alternative to cages/zookeeper?<br>
<br>
Thanks for any help with this!<br>
<br>
<br>
<br>
<br>
</blockquote></div><br>
</div></div>
</div><br>

      </body></html>
--0-362242932-1291126731=:32612--