Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 64AF1200D3C for ; Tue, 14 Nov 2017 15:50:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 61AE8160C09; Tue, 14 Nov 2017 14:50:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A830A1609EF for ; Tue, 14 Nov 2017 15:50:04 +0100 (CET) Received: (qmail 58994 invoked by uid 500); 14 Nov 2017 14:50:03 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 58973 invoked by uid 99); 14 Nov 2017 14:50:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Nov 2017 14:50:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id F0C5B1A0B2F for ; Tue, 14 Nov 2017 14:50:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id Xr4ACBt7KaLz for ; Tue, 14 Nov 2017 14:50:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 7E0945F24F for ; Tue, 14 Nov 2017 14:50:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 09299E031E for ; Tue, 14 Nov 2017 14:50:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id BD272240D2 for ; Tue, 14 Nov 2017 14:50:00 +0000 (UTC) Date: Tue, 14 Nov 2017 14:50:00 +0000 (UTC) From: "Joshua McKenzie (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-13871) cassandra-stress user command misbehaves when retrying operations MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 14 Nov 2017 14:50:05 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-13871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-13871: ---------------------------------------- Priority: Minor (was: Major) > cassandra-stress user command misbehaves when retrying operations > ----------------------------------------------------------------- > > Key: CASSANDRA-13871 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13871 > Project: Cassandra > Issue Type: Bug > Components: Stress > Reporter: Daniel Cranford > Priority: Minor > Attachments: 0001-Fixing-cassandra-stress-user-operations-retry.patch > > > o.a.c.stress.Operation will retry queries a configurable number of times. When the "user" command is invoked the o.a.c.stress.operations.userdefined SchemaInsert and SchemaQuery operations are used. > When SchemaInsert and SchemaQuery are retried (eg after a Read/WriteTimeout exception), they advance the PartitionIterator used to generate the keys to insert/query (SchemaInsert.java:85 SchemaQuery.java:129) This means each retry will use a different set of keys. > The predefined set of operations avoid this problem by packaging up the arguments to bind to the query into the RunOp object so that retrying the operation results in exactly the same query with the same arguments being run. > This problem was introduced by CASSANDRA-7964. Prior to CASSANDRA-7964 the PartitionIterator (Partition.RowIterator before the change) was reinitialized prior to each query retry, thus generating the same set of keys each time. > This problem is reported rather confusingly. The only error that shows up in a log file (specified with -log file=foo.log) is the unhelpful > {noformat} > java.io.IOException Operation x10 on key(s) [foobarkey]: Error executing: (NoSuchElementException) > at org.apache.cassandra.stress.Operation.error(Operation.java:136) > at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:114) > at org.apache.cassandra.stress.userdefined.SchemaQuery.run(SchemaQuery.java:158) > at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:459) > {noformat} > Standard error is only slightly more helpful, displaying the ignorable initial read/write error, and confusing java.util.NoSuchElementException lines (caused by PartitionIterator exhaustion) followed by the above IOException with stack trace, eg > {noformat} > com.datastax.drive.core.exceptions.ReadTimeoutException: Cassandra timeout during read query.... > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.util.NoSuchElementException > java.io.IOException Operation x10 on key(s) [foobarkey]: Error executing: (NoSuchElementException) > at org.apache.cassandra.stress.Operation.error(Operation.java:136) > at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:114) > at org.apache.cassandra.stress.userdefined.SchemaQuery.run(SchemaQuery.java:158) > at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:459) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org For additional commands, e-mail: commits-help@cassandra.apache.org