Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 51574 invoked from network); 30 Jul 2010 02:45:34 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 30 Jul 2010 02:45:34 -0000 Received: (qmail 49022 invoked by uid 500); 30 Jul 2010 02:45:33 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 48861 invoked by uid 500); 30 Jul 2010 02:45:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 48853 invoked by uid 99); 30 Jul 2010 02:45:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Jul 2010 02:45:31 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jianing@gmail.com designates 209.85.161.172 as permitted sender) Received: from [209.85.161.172] (HELO mail-gx0-f172.google.com) (209.85.161.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Jul 2010 02:45:26 +0000 Received: by gxk1 with SMTP id 1so486904gxk.31 for ; Thu, 29 Jul 2010 19:45:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=0oWbNzVEkzbVWBn2eK9qsTGSzfugwUeaysD8o4UNNIc=; b=LuFn8SVsF5hbF/2J3kNOl+yVeSUzj7Hac6rIrRwvXVW7TYJYmWtWFvuoeCHhhXl6sx ip+dur+Lwfme4j+3uJG7gkRnd20jT2QTPPJsfmgHMT8Pw8NbYRROf7A6hwtupEr8Jp2z /AIlUKjOgyIlDeRus3qN10d2X4gHjw+3YgVxA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Tr4wLKHmkogK7PTCPzF/mkyQjIsvz6HqxLIE1KG4x3hWNdbL5E+po1wYtruO7rcT/d IbuDLJKu0/6sEOOSLNnFRPt5/HvXjI1ZWaRg23IQHl3z0AkXqNx7P0izwIfOUJ81t30l ZqjR/AjYgrIC/8fYBgWujjh3Dy5N7UFRL7mHE= MIME-Version: 1.0 Received: by 10.150.103.7 with SMTP id a7mr2311031ybc.69.1280457905594; Thu, 29 Jul 2010 19:45:05 -0700 (PDT) Received: by 10.42.1.18 with HTTP; Thu, 29 Jul 2010 19:45:05 -0700 (PDT) In-Reply-To: <1f0a5bc2-ab75-cee1-aa7d-fbd21f799b8a@me.com> References: <1f0a5bc2-ab75-cee1-aa7d-fbd21f799b8a@me.com> Date: Thu, 29 Jul 2010 19:45:05 -0700 Message-ID: Subject: Re: cassandra 0.6.1 read returns wrong data? From: Jianing Hu To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable That's an interesting thought. My code runs in FCGI and although the cassandra connection is used to serve multiple requests, those requests are supposedly processed sequentially, in a while ($request->Accept() >=3D 0) loop. However, we do call FCGI::finish to close the request (so the HTTP request would finish) while continue writing to cassandra. I wonder if that may cause the next request to be accepted and trump the current one? I don't think it should but it's worth testing. Thanks, - Jianing On Thu, Jul 29, 2010 at 6:23 PM, Aaron Morton wro= te: > I was accidentally sharing connections between threads, and getting stran= ge > results. Is your client multi threaded? > > Can you provide some more information, such as the client library, how th= e > data is written and=A0 how you're deciding that the returned results are = the > wrong ones. > > Is the read inconsistency against data that is frequently changing? Could= it > be a problem with the way the data is being stored? > > Aaron > > > > > On 30 Jul, 2010,at 11:43 AM, Jianing Hu wrote: > > Hi Aaron, > > Thanks for the reply. Can you explain what you mean by "sharing > connections around"? > > I'm just calling a simple "get", and the data returned is for a > completely different key. It's intermittent and hard to produce in my > test environment, but can be observed in our production environment > couple hundred times a day. > > Thanks, > - Jianing > > On Thu, Jul 29, 2010 at 2:58 PM, Aaron Morton > wrote: >> I noticed this once when accidentally sharing connections around. Could >> that >> be the case ? >> >> What sort of commands are you running ? Could you be seeing this problem= ? >> http://www.mail-archive.com/user@cassandra.apache.org/msg04831.html >> >> Aaron >> >> >> On 29 Jul, 2010,at 12:47 PM, Jianing Hu wrote: >> >> We recently migrated part of our MySQL database to a 3-node Cassandra >> cluster with a replication factor of 3. Couple of days ago we noticed >> that Cassandra sometimes returns the wrong data. Not corrupted data, >> but data for a different key than the one being asked for. This error >> appears to be random and intermittent, and happens for maybe every 10K >> reads. I'm working on a test suite that can reproduce this. Meanwhile >> just wanted to ask if anyone has seen this problem before? I've tried >> consistency levels of both QUORUM and ONE, and see the issue with >> both. >> >> Thanks, >> - Jianing >> >