Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DA9941721D for ; Tue, 24 Mar 2015 12:51:59 +0000 (UTC) Received: (qmail 55779 invoked by uid 500); 24 Mar 2015 12:51:47 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 55740 invoked by uid 500); 24 Mar 2015 12:51:47 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 55730 invoked by uid 99); 24 Mar 2015 12:51:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Mar 2015 12:51:47 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of duncan.sands@gmail.com designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-we0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Mar 2015 12:51:41 +0000 Received: by weoy45 with SMTP id y45so12771743weo.2 for ; Tue, 24 Mar 2015 05:50:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=YtJq4VrqOJmmkOrTS9MXX+Nz1pJ4Ujt2kfOMxdfaqFE=; b=v5cKBtbDz1aIUpwYBYR+Lo2MbSs4RbHO6FxVk03LmsJKWNfADcWuVBsGL6sUt3FuT4 TTtf0w3bNkMVLP+s8b22ngp7ZZy8kH1bPXZ2vdg8H30a2A0hbD4DY6MtSUh0oAZwPGBc +wl4BO5bsqxB5D22z7PV+L/dps9splcpr6FA8hPsvHYCsKfGhbdjM6rCyOxBgKgt02Jh P/xpnvNJp6y6iRxnB4/UTbwTYLy7yyXr8DnOji9m6lBAfXcDOWhunq4u+xcEu67lCdah cNCxR2xFUpLIJhXAXop2loDH2xSzkI1n0HNXRRJMBsnpfaKPTgKy/Z0MP35be3B/ysFd s2VA== X-Received: by 10.180.198.110 with SMTP id jb14mr28203120wic.57.1427201435981; Tue, 24 Mar 2015 05:50:35 -0700 (PDT) Received: from ?IPv6:2a01:e35:2e83:a840:c860:c541:edd7:8a1e? ([2a01:e35:2e83:a840:c860:c541:edd7:8a1e]) by mx.google.com with ESMTPSA id hl15sm15810145wib.3.2015.03.24.05.50.35 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 24 Mar 2015 05:50:35 -0700 (PDT) Message-ID: <55115D9B.5080303@gmail.com> Date: Tue, 24 Mar 2015 13:50:35 +0100 From: Duncan Sands User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: error deleting messages References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi Joss, On 24/03/15 12:58, joss Earl wrote: > I run into trouble after a while if I delete rows, this happens in both 2.1.3 > and 2.0.13, and I encountered the same problem when using either the datastax > java driver or the stock python driver. > The problem is reproducible using the attached python program. > > Once the problem is encountered, the table becomes unusable.. > > cqlsh:test1> select id from msg limit 1; > Request did not complete within rpc_timeout. my guess is that due to previous delete attempts your table is filled with tombstones, and this is why the read times out: it hits the tombstone limit. Check your Cassandra node logs to see if they mention tombstones. Ciao, Duncan. > > So, questions are: > am I doing something wrong ? > is this expected behaviour ? > is there some way to fix the table and make it usable again once this has happened ? > if this is a bug, what is the best way of reporting it ? > > Many thanks > Joss