Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of prescod@gmail.com designates
 74.125.83.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:reply-to:from:date:message-id:subject:to:content-type;
        b=sxykpI7Yu5kwgNJOO5mzba0NrCXOQUAZvofpA7xTBJ/VwuVNrU374GqB3N7xe/UP9G
         uSbwzn+AiytVTlh4rjS6EIbIAWL7/HJdrITSpFDCPPZ0Zi6hBBwwZDOnw1HYkFqWHlJS
         1H67Z/3wN180Wou+rCQZOcKwmnROkc9+SCGpk=
MIME-Version: 1.0
Reply-To: paul@prescod.net
From: Paul Prescod <prescod@gmail.com>
Date: Tue, 6 Apr 2010 00:11:04 -0700
Message-ID: <w2u1cb725391004060011h64d687c3i5e340ae41785243c@mail.gmail.com>
Subject: How do vector clocks and conflicts work?
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=001636b2b1624afe5f04838c2730

--001636b2b1624afe5f04838c2730
Content-Type: text/plain; charset=UTF-8

This may be the blind leading the blind...

On Mon, Apr 5, 2010 at 11:54 PM, Tatu Saloranta <tsaloranta@gmail.com>wrote:
>...


> I think the key is that this is not automatic -- there is no general
> mechanism for aggregating distinct modifications. Point being that you
> could choose one amongst right answers, but not what to do with
> concurrent modifications. So what is done instead is have
> application-specific resolution strategy which makes use of semantics
> of operations, to know how to combine such concurrent modifications
> into "correct" answer.


I agree with all of that.


> I don't know if this is trivial for case of
> counter increments: especially since two concurrent increments give
> same new value; yet correct combined result would be one higher (both
> used base, added one).
>

As long as the conflict resolver knows that two writers each tried to
increment, then it can increment twice. The conflict resolver must know
about the semantics of "increment" or "decrement" or "string append" or
"binary patch" or whatever other merge strategy you choose. You'll register
your "strategy" with Cassandra and it will apply it. Presumably it will also
maintain enough context about what you were trying to accomplish to allow
the merge strategy plugin to do it properly.


> That is to say, my understanding was that vector clocks would be
> required but not sufficient for reconciliation of concurrent value
> updates.
>

I agree. They are necessary, but not sufficient. The other half is the
"merge strategy plugin" thing, which is analogous to custom comparators in
Cassandra today.

In CASSANDRA-580, Pedro Gomes talks about the plugins like this: "I suppose
for the beginning of the discussion that some sort of interface will be
implemented to allow pluggable logic to be added to the server, personalized
scripts were an idea, I have heard. "

Kevin Kakugawa replies that they'll just use Java class libraries as a first
pass.

 Paul Prescod

--001636b2b1624afe5f04838c2730
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div>This may be the blind leading the blind...</div><div><br></div>On Mon,=
 Apr 5, 2010 at 11:54 PM, Tatu Saloranta <span dir=3D"ltr">&lt;<a href=3D"m=
ailto:tsaloranta@gmail.com">tsaloranta@gmail.com</a>&gt;</span> wrote:<br><=
div class=3D"gmail_quote">

<div>&gt;...</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div><d=
iv class=3D"h5">
</div></div>I think the key is that this is not automatic -- there is no ge=
neral<br>
mechanism for aggregating distinct modifications. Point being that you<br>
could choose one amongst right answers, but not what to do with<br>
concurrent modifications. So what is done instead is have<br>
application-specific resolution strategy which makes use of semantics<br>
of operations, to know how to combine such concurrent modifications<br>
into &quot;correct&quot; answer. </blockquote><div><br></div><div>I agree w=
ith all of that.</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" st=
yle=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">I do=
n&#39;t know if this is trivial for case of<br>


counter increments: especially since two concurrent increments give<br>
same new value; yet correct combined result would be one higher (both<br>
used base, added one).<br></blockquote><div><br></div><div>As long as the c=
onflict resolver knows that two writers each tried to increment, then it ca=
n increment twice. The conflict resolver must know about the semantics of &=
quot;increment&quot; or &quot;decrement&quot; or &quot;string append&quot; =
or &quot;binary patch&quot; or whatever other merge strategy you choose. Yo=
u&#39;ll register your &quot;strategy&quot; with Cassandra and it will appl=
y it. Presumably it will also maintain enough context about what you were t=
rying to accomplish to allow the merge strategy plugin to do it properly.</=
div>

<div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8=
ex;border-left:1px #ccc solid;padding-left:1ex;">
That is to say, my understanding was that vector clocks would be<br>
required but not sufficient for reconciliation of concurrent value<br>
updates.<br></blockquote><div><br></div><div>I agree. They are necessary, b=
ut not sufficient. The other half is the &quot;merge strategy plugin&quot; =
thing, which is analogous to custom comparators in Cassandra today.</div>

<div><br></div><div>In CASSANDRA-580, Pedro Gomes talks about the plugins l=
ike this: &quot;<span class=3D"Apple-style-span" style=3D"font-family: Aria=
l, sans-serif; font-size: 12px; border-collapse: collapse; ">I suppose for =
the beginning of the discussion that some sort of interface will be impleme=
nted to allow pluggable logic to be added to the server, personalized scrip=
ts were an idea, I have heard. &quot;</span></div>

<div><span class=3D"Apple-style-span" style=3D"font-family: Arial, sans-ser=
if; font-size: 12px; border-collapse: collapse; "><br></span></div><div><sp=
an class=3D"Apple-style-span" style=3D"font-family: Arial, sans-serif; font=
-size: 12px; border-collapse: collapse; ">Kevin Kakugawa replies that they&=
#39;ll just use Java class libraries as a first pass.</span></div>

<div>=C2=A0</div><div>=C2=A0Paul Prescod</div><div><br></div></div><br>

--001636b2b1624afe5f04838c2730--