Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 816F3200B3C for ; Wed, 13 Jul 2016 22:02:53 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7FCF2160A6A; Wed, 13 Jul 2016 20:02:53 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 55D2C160A62 for ; Wed, 13 Jul 2016 22:02:52 +0200 (CEST) Received: (qmail 45729 invoked by uid 500); 13 Jul 2016 20:02:50 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45717 invoked by uid 99); 13 Jul 2016 20:02:50 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jul 2016 20:02:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id EBCAAC9D83 for ; Wed, 13 Jul 2016 20:02:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.198 X-Spam-Level: * X-Spam-Status: No, score=1.198 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.fr Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id wSIUlUtw8_GS for ; Wed, 13 Jul 2016 20:02:45 +0000 (UTC) Received: from nm38-vm3.bullet.mail.ir2.yahoo.com (nm38-vm3.bullet.mail.ir2.yahoo.com [212.82.97.153]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 2F86360D40 for ; Wed, 13 Jul 2016 20:02:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.fr; s=s2048; t=1468440158; bh=GwvInUisHtIRl/tViWnOXsg3/A64aGJv9ghWnlMjGfs=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject; b=sPlP/V5jUShH056J/e1LUsrsSnghr0dCXZLVAk2cee2MHeC8+LrUMjZXD2dypR12DZE9k7+CkGfFCvXqfZk0P9RT3B37zu+Ya1Qe2yvN/py8VnZ3XYYJ53Sg8GkSAUfREd623oU1apkbAM1NOuk5jZ2CeXqaoFxmr2ntlsftxLISP+4ohbP9O/dvkUUaIURyE389UCWRtkc/7QQqV2lt6UZQBxR9iPWEqzkzTyU5rkAAJjnEdErh5Qvxd0zeVECVi+eOhqJel0YxttAZVVZS2iRoKGKDkO3LpMheGFQ4yyZN7uN55B9P3lVo7acz6XMC+h2iWjOOHhFBFfb3jbkF2g== Received: from [212.82.98.124] by nm38.bullet.mail.ir2.yahoo.com with NNFMP; 13 Jul 2016 20:02:38 -0000 Received: from [212.82.98.107] by tm17.bullet.mail.ir2.yahoo.com with NNFMP; 13 Jul 2016 20:02:38 -0000 Received: from [127.0.0.1] by omp1044.mail.ir2.yahoo.com with NNFMP; 13 Jul 2016 20:02:38 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 86064.25041.bm@omp1044.mail.ir2.yahoo.com X-YMail-OSG: aWHVzmwVM1mafR_r_2IyX6W02Vkic9foBi8F2qMq02ebpCPjHB0.mN1nR1GNtT9 HcoehgLpbi4l1emWPvauflK76WYsJPSFji2eh7KkWq2EBJrmBujkaswXHKUTNLwyJG6Ac6_E7yhD SY18Yr0CdsktcZpydDnlyAq7rG532feSmEd1ktkl.39t7EaSRQtoK.uOlLfqkS9.Z8uQ1cNTBieh p8NJ7DdJv90lkCIeUPBRiVFYPFjZJiDeS2J4AeRPWOaMDHRzBt1BJSFgCUnQ3MFiV7PnGuJY1s8E O_.WTeoFXyb8lhJEQvUqyNti54BFiNmO2inA4kgMjss08n0ppD8SDB1cDgAeKj9nBeeD2DHwx4jr smT9RKD46AtauJL.senCJ48P8cV_DUM6HwS0xpRZtHzFDkqWpevt0FZ4s3E5n6Mn8tXu2VqW_Nme j6gvBj7nreSmHiTm0ebUKwPnJLuLpyCNwXN6zWpJEMBURkAVUPuhcnj75cmFhrRUvVN4l.gNQ.s3 ORql9BnknyUWv2AAgcOdWZ_6osDgBScARseu13anx9_APP1UyxzY1H9h24Sz9bGdKfwo2_p.SJMj sP3PqPJJBst5zN3pte3EiN7Sq4WG7AI_ZLCoPjIOE4y.oVmUd0Df_HY3hnRg- Received: from jws11135.mail.ir2.yahoo.com by sendmailws165.mail.ir2.yahoo.com; Wed, 13 Jul 2016 20:02:37 +0000; 1468440157.033 Date: Wed, 13 Jul 2016 20:02:36 +0000 (UTC) From: Romain Hardouin Reply-To: Romain Hardouin To: "user@cassandra.apache.org" Message-ID: <1058113985.4230290.1468440156697.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: References: Subject: Re: NoHostAvailableException coming up on our server MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_4230286_1257604290.1468440156688" archived-at: Wed, 13 Jul 2016 20:02:53 -0000 ------=_Part_4230286_1257604290.1468440156688 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Put the driver logs in debug mode to see what's happen.Btw I am surprised b= y the few requests by connections in your setup: .setConnectionsPerH= ost(HostDistance.LOCAL, 20, 20) .setMaxRequestsPerConnection(HostDistance.LOCAL, 128) It looks lik= e a protocol v2 settings (Cassandra 2.0) because it was limited to 128 requ= ests per connection. You're using C* 3.3 so the protocol v4.You can go up t= o 32K since protocol v3. As a first step I would try to open only 2 connect= ions with 16K in=C2=A0MaxRequestsPerConnection. Then try to fine tune. Best, Romain Le Mardi 12 juillet 2016 23h57, Abhinav Solan = a =C3=A9crit : =20 I am using 3.0.0 version over apache-cassandra-3.3=C2=A0 On Tue, Jul 12, 2016 at 2:37 PM Riccardo Ferrari wrote= : What driver version are you using? You can look at the LoggingRetryPolicy to have more meaningful messages in = your logs. best, On Tue, Jul 12, 2016 at 9:02 PM, Abhinav Solan wr= ote: Thanks, JohnnyActually, they were running .. it went through a series of re= ad and writes .. and recovered after the error.Is there any settings I can = specify in preparing the Session at java client driver level, here are my c= urrent settings -=C2=A0PoolingOptions poolingOptions =3D new PoolingOptions= () .setConnectionsPerHost(HostDistance.LOCAL, 20, 20) .setMaxRequestsPerConnection(HostDistance.LOCAL, 128) .setNewConnectionThreshold(HostDistance.LOCAL, 100); Cluster.Builder builder =3D Cluster.builder() .addContactPoints(cp) .withPoolingOptions(poolingOptions) .withProtocolVersion(ProtocolVersion.NEWEST_SUPPORTED) .withPort(port); On Tue, Jul 12, 2016 at 11:47 AM Johnny Miller = wrote: Abhinav - your getting that as the driver isn=E2=80=99t finding any hosts u= p for your query. You probably need to check if all the nodes in your clust= er are running. See:=C2=A0http://docs.datastax.com/en/drivers/java/3.0/com/datastax/driver/= core/exceptions/NoHostAvailableException.html Johnny On 12 Jul 2016, at 18:46, Abhinav Solan wrote: Hi Everyone, I am getting this error on our server, it comes and goes seems the connecti= on drops a comes back after a while -Caused by: com.datastax.driver.core.ex= ceptions.NoHostAvailableException: All host(s) tried for query failed (trie= d: ****************:9042 (com.datastax.driver.core.exceptions.ConnectionExc= eption: [****************] Pool is CLOSING)) =09at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHand= ler.java:218) =09at com.datastax.driver.core.RequestHandler.access$1000(RequestHandler.ja= va:43) =09at com.datastax.driver.core.RequestHandler$SpeculativeExecution.sendRequ= est(RequestHandler.java:284) =09at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHand= ler.java:115) =09at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.ja= va:91) =09at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.j= ava:129)Can anyone suggest me what can be done to handle this error ?=20 Thanks,Abhinav ------=_Part_4230286_1257604290.1468440156688 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Put the drive= r logs in debug mode to see what's happen.
Btw I am surprised by the few requests by connections in you= r setup:
        .setConnectionsPerHost(HostDistance.LOCAL, 20=
, 20)
         .setMaxRequestsPerConnection(=
HostDistance.LOCAL, 128)
It looks like a protocol v2 settings (Cassandra 2.0) becaus= e it was limited to 128 requests per connection. You're using C* 3.3 so the= protocol v4.
You can go up to 32K since protocol v3. As a first st= ep I would try to open only 2 connections with 16K in MaxReq= uestsPerConnection. Then try to fine tune.

Best,
Romain
=

Le Mardi 12 juillet= 2016 23h57, Abhinav Solan <abhinav.solan@gmail.com> a =C3=A9crit :


I am using 3.0.0 version over apache-cassandra-3.3&nb= sp;

On Tue, Jul 12, 2016 at 2:37 PM Riccard= o Ferrari <ferrarir@gmail.com> wrote:
What driver version are you using?

You can look at the LoggingRetryPolicy to have= more meaningful messages in your logs.

=
be= st,

<= div class=3D"yiv1686570044gmail_quote" id=3D"yui_3_16_0_ym19_1_146840744202= 9_5708">On Tu= e, Jul 12, 2016 at 9:02 PM, Abhinav Solan <abhinav.solan@gmail.com= > wrote:
Thanks, Johnny
Actually, they were running .. it went through a series of read and= writes .. and recovered after the error.
Is th= ere any settings I can specify in preparing the Session at java client driv= er level, here are my current settings - 
PoolingOptions poolingOptions =3D new PoolingOptions()
 =
        .setConnectionsPerHost(HostDistance.LOCAL, 20, 2=
0)
         .setMaxRequestsPerConnection(HostDista=
nce.LOCAL<=
span style=3D"color:rgb(204,120,50);">, 128)
         .setNewConnectionThresho=
ld(HostDistance.L=
OCAL, 100);=


 Cluster.Bu=
ilder builder =3D Cluster.builder=
()
         .addContactPoints(cp)
     =
    .withPoolingOptions(poolingOptions)
         .withPro=
tocolVersion(ProtocolVersion.NEWEST_SUPPORTED)
         .withPort(<=
span style=3D"color:rgb(152,118,170);">port);


On Tue, Jul = 12, 2016 at 11:47 AM Johnny Miller <johnny.p.miller@gmail.com> wrote:
Abhinav - your getting that as the driver isn=E2=80=99= t finding any hosts up for your query. You probably need to check if all th= e nodes in your cluster are running.



Joh= nny
<= br clear=3D"none">
<= blockquote type=3D"cite" id=3D"yui_3_16_0_ym19_1_1468407442029_5698">
<= font size=3D"2">On 12 Jul 2016, at 18:46, Abhinav Solan <abhinav.solan@gmail.com&g= t; wrote:

Hi Everyone,

I am getting = this error on our server, it comes and goes seems the connection drops a co= mes back after a while -
Caused by: com.datastax.driver.c=
ore.exceptions.NoHostAvailableException: All host(s) tried for query failed=
 (tried: ****************:9042 (com.datastax.driver.core.exceptions.Connect=
ionException: [****************] Pool is CLOSING))
=09at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHand=
ler.java:218)
=09at com.datastax.driver.core.RequestHandler.access$1000(RequestHandler.ja=
va:43)
=09at com.datastax.driver.core.RequestHandler$SpeculativeExecution.sendRequ=
est(RequestHandler.java:284)
=09at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHand=
ler.java:115)
=09at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.ja=
va:91)
=09at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.j=
ava:129)
Can anyone suggest me what can be done to handle this error ? 
Thanks,
Abhinav

<= /div>

<= /div>


------=_Part_4230286_1257604290.1468440156688--