Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0CC63200C7F for ; Wed, 24 May 2017 11:05:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0B5B8160BB4; Wed, 24 May 2017 09:05:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2A5B9160B9C for ; Wed, 24 May 2017 11:05:22 +0200 (CEST) Received: (qmail 6740 invoked by uid 500); 24 May 2017 09:05:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 6730 invoked by uid 99); 24 May 2017 09:05:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 May 2017 09:05:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 2CFD2C1471 for ; Wed, 24 May 2017 09:05:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id PW18qS5cbq0l for ; Wed, 24 May 2017 09:05:18 +0000 (UTC) Received: from mail-wm0-f50.google.com (mail-wm0-f50.google.com [74.125.82.50]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 6D4495F342 for ; Wed, 24 May 2017 09:05:18 +0000 (UTC) Received: by mail-wm0-f50.google.com with SMTP id e127so64751935wmg.1 for ; Wed, 24 May 2017 02:05:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=uqk+vOiCGiLxBHEabVap1E3UHW8blBn+lHxPvrJu4J8=; b=L4f5uV74N/WjJUx0IT/GIjFFZ9ncjE5X5SBiQy0SQ3LMbVJZNSBPKxY72U6TUwrID3 VCd61TOnHrJ+soIRG0Qt0iu5LVj15RCHaRZR+yM7+WONeSDqR4yhUP1Mzmv9sE8xktBs x2GV4tMP7IKv+IyWMiwdt5fMc5DsqO6QJ3nYqtjGDUN5TBB2e31oLboCNpkJZ5pBCTAq Rflis9jkX2ADOpt7kCgfi6koTB6sWGw0HCLChAYmLO9HoKI+KqtmZi8DgouqWPm1rnRi 3zdLAKPnBe4tnJNmMDhU2ZMpJG4UEFy5bD+NjyIuRq9cSkouGgH8ZrWgJdKd8EiLEg3x Wa/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=uqk+vOiCGiLxBHEabVap1E3UHW8blBn+lHxPvrJu4J8=; b=tmrL5zFcD+DzE8blHTcfzVB2Ngkbh1TUa32PDnVq/9G8HBnZ9FxX1ndbzw1nP0mtzE 7MU6S1M+BL0yOQtttHFcb3Uv605oe2KuOLO0zl2T9797rrdZBSKckVmKvAtnneVOvtVJ agOKC+/0tHmfPG58Cn5co1Gybi++ZRS9U8RzCm0Yj+0lnmGYQqJijEAf79TW+xnegtgM eusWrG758FkyY38rQW3BrMXXwLz/sV8O1KpgidoxU4z9y7huLtbXwTewq7K9I8DufbWB mfYY7PZHwkQJVCJDX33j5S83nag5fnnOHgv8VKm1Bh1e8FHAxIL6s5330/L9IeJDrifD iexQ== X-Gm-Message-State: AODbwcDp6aE/df3h6YbU6l43sRjE8QRYcTeBwiTe3JSyXvXGw0G7NY2T r/7aAMZeKY2TspaQKeDXB23jrIVhJQ== X-Received: by 10.80.176.102 with SMTP id i93mr11803859edd.116.1495616711245; Wed, 24 May 2017 02:05:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.208.215 with HTTP; Wed, 24 May 2017 02:04:50 -0700 (PDT) In-Reply-To: References: From: Nicolas Guyomar Date: Wed, 24 May 2017 11:04:50 +0200 Message-ID: Subject: Re: How to find dataSize at client side? To: "techpyaasa ." Cc: user@cassandra.apache.org Content-Type: multipart/alternative; boundary="f403045c7dfccb42400550416697" archived-at: Wed, 24 May 2017 09:05:23 -0000 --f403045c7dfccb42400550416697 Content-Type: text/plain; charset="UTF-8" Hi, The list is opened : https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user, feel free to subscribe. Datastax is the main maintainer of the java driver, which is open source ( https://github.com/datastax/java-driver ) , which is not the same driver as the DSE one : https://github.com/datastax/java-dse-driver On 24 May 2017 at 10:53, techpyaasa . wrote: > Hi Nicolas > > I think only DataStax Enterprise(paid) c* version can ask questions/get > support from datastax :( > > On Tue, May 23, 2017 at 9:44 PM, techpyaasa . > wrote: > >> Thanks for your reply.. >> >> On Tue, May 23, 2017 at 7:40 PM, Nicolas Guyomar < >> nicolas.guyomar@gmail.com> wrote: >> >>> Hi, >>> >>> If you were to know the batch size on client side to make sure it does >>> not get above the 5kb limit, so that you can "limit the number of >>> statements in a batch", I would suspect you do not need batch at all right >>> ? See https://inoio.de/blog/2016/01/13/cassandra-to-batch-or-not- >>> to-batch/ >>> >>> As for your question, you might get an answer on the java driver ML : >>> java-driver-user@lists.datastax.com >>> >>> >>> On 23 May 2017 at 15:25, techpyaasa . wrote: >>> >>>> >>>> * WARN [SharedPool-Worker-1] 2017-05-22 20:28:46,204 >>>> BatchStatement.java (line 253) Batch of prepared statements for >>>> [site24x7.wm_rawstats_tb, site24x7.wm_rawstats] is of size 6122, exceeding >>>> specified threshold of 5120 by 1002* >>>> We are frequently getting this message in logs, so I wanted to restrict >>>> inserts at client side by calculating *dataSize* of insert/batch >>>> statements before sending it to c* servers. >>>> >>>> We are using datastax java drivers , how can I get dataSize here?? >>>> >>>> >>>> Any ideas?? >>>> >>>> Thanks in advance >>>> TechPyaasa >>>> >>> >>> >> > --f403045c7dfccb42400550416697 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,


Datastax i= s the main maintainer of the java driver, which is open source (https://github.com/datastax/java-d= river )=C2=A0, which is not the same driver as the DSE one :=C2=A0https://github.com/datas= tax/java-dse-driver=C2=A0



On 24 May 2017 at 10:= 53, techpyaasa . <techpyaasa@gmail.com> wrote:
Hi Nicolas

I think only Dat= aStax Enterprise(paid) c* version can ask questions/get support from datast= ax :(

On Tue, May 23, 2017 at 9:44 PM, tech= pyaasa . <techpyaasa@gmail.com> wrote:
Thanks for your reply..

On Tue, May 23, 2017 = at 7:40 PM, Nicolas Guyomar <nicolas.guyomar@gmail.com> wrote:
Hi,

<= /div>
If you were to know the batch size on client side to make sure it= does not get above the 5kb limit, so that you can "limit the number o= f statements in a batch", I would suspect you do not need batch at all= right ? See =C2=A0https://inoio.de/blog/2016/01/13/cassandra-to-batch-or-not-to-batch/=C2=A0

As for your question, you might get an answer on the java driver ML = :=C2=A0java-driver-user@lists.datastax.com=C2=A0


On 23 May 2017 at 15:25, techpyaas= a . <techpyaasa@gmail.com> wrote:
=C2=A0WARN [SharedPool-Worker-1] 2017-05-= 22 20:28:46,204 BatchStatement.java (line 253) Batch of prepared statements= for [site24x7.wm_rawstats_tb, site24x7.wm_rawstats] is of size 6122, excee= ding specified threshold of 5120 by 1002

We are frequently g= etting this message in logs, so I wanted to restrict inserts at client side= by calculating dataSize of insert/batch statements before sending i= t to c* servers.

We are using datastax java drivers , how can I get = dataSize here??


Any ideas??

Thanks in advance
TechPyaasa




--f403045c7dfccb42400550416697--