Return-Path: 
 <user-return-24016-apmail-spark-user-archive=spark.apache.org@spark.apache.org>
X-Original-To: apmail-spark-user-archive@minotaur.apache.org
Delivered-To: apmail-spark-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 2C58517DEE
	for <apmail-spark-user-archive@minotaur.apache.org>;
 Sat, 10 Jan 2015 03:16:28 +0000 (UTC)
Received: (qmail 64965 invoked by uid 500); 10 Jan 2015 03:16:26 -0000
Delivered-To: apmail-spark-user-archive@spark.apache.org
Received: (qmail 64884 invoked by uid 500); 10 Jan 2015 03:16:26 -0000
Mailing-List: contact user-help@spark.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@spark.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@spark.apache.org>
List-Post: <mailto:user@spark.apache.org>
List-Id: <user.spark.apache.org>
Delivered-To: mailing list user@spark.apache.org
Received: (qmail 64874 invoked by uid 99); 10 Jan 2015 03:16:26 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Jan 2015 03:16:26 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ankur.srivastava@gmail.com
 designates 209.85.216.181 as permitted sender)
Received: from [209.85.216.181] (HELO mail-qc0-f181.google.com)
 (209.85.216.181)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Jan 2015 03:16:21 +0000
Received: by mail-qc0-f181.google.com with SMTP id m20so12030905qcx.12
        for <user@spark.apache.org>; Fri, 09 Jan 2015 19:14:30 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=Nk2g9HTMkcK9RkgmITN8twGbmCBfKnZIWwakeJMCe2Y=;
        b=XCaN1GEBardPYBCIccaab7NxXfLuYz4Cr1DFIOOJ0hUVDESU6fyHJuruRyyZinsB18
         07snwkHWrRzJuHNY7BzdfPOhDnKPnU1F88kCV8afH6oj8Lwmd7zfs8uuKNTUdhKNYkNs
         anB2+K3pXgFfeqfAecanAM5ULTLyul6EEX00x5vh7geTUP/bFI5ywmapPIN7zyKJLYut
         d3e9CWglkvjY0VEH0ElI2ybDg8mI36iEgprYSVRQdLssmACgh2nCrUfn9foFrV4pLrzD
         Zl92VkXVMVJo8fs8Xzux++g4J8JAAr75Jwt1j8JwlUowtM3DDil5arQKtxCTNJjDOKnM
         CG4w==
MIME-Version: 1.0
X-Received: by 10.140.34.67 with SMTP id k61mr28306545qgk.95.1420859670207;
 Fri, 09 Jan 2015 19:14:30 -0800 (PST)
Received: by 10.140.95.227 with HTTP; Fri, 9 Jan 2015 19:14:30 -0800 (PST)
Date: Fri, 9 Jan 2015 19:14:30 -0800
Message-ID: 
 <CABq2Xnb1pmqdZiuBjkaW0A5S4mc0tjQx78uAVTTf6c6DjCnXnQ@mail.gmail.com>
Subject: Issue writing to Cassandra from Spark
From: Ankur Srivastava <ankur.srivastava@gmail.com>
To: "user@spark.apache.org" <user@spark.apache.org>
Content-Type: multipart/alternative; boundary=001a11c0dd5ceb2341050c43ab3a
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11c0dd5ceb2341050c43ab3a
Content-Type: text/plain; charset=UTF-8

Hi,

We are currently using spark to join data in Cassandra and then write the
results back into Cassandra. While reads happen with out any error during
the writes we see many exceptions like below. Our environment details are:

- Spark v 1.1.0
- spark-cassandra-connector-java_2.10 v 1.1.0

We are using below settings for the writer

spark.cassandra.output.batch.size.rows=1

spark.cassandra.output.concurrent.writes=1

com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s)
tried for query failed (tried: [] - use getErrors() for details)

at
com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:108)

at com.datastax.driver.core.RequestHandler$1.run(RequestHandler.java:179)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)

Thanks

Ankur

--001a11c0dd5ceb2341050c43ab3a
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div>We are currently using spark to joi=
n data in Cassandra and then write the results back into Cassandra. While r=
eads happen with out any error during the writes we see many exceptions lik=
e below. Our environment details are:</div><div><br></div><div>- Spark v 1.=
1.0</div><div>- spark-<span class=3D"">cassandra</span>-connector-java_2.10=
 v 1.1.0</div><div><br></div><div>We are using below settings for the write=
r</div><div><table style=3D"margin:0px;padding:0px;border:0px;font-size:13p=
x;vertical-align:baseline;border-collapse:collapse;border-spacing:0px;color=
:rgb(0,0,0);font-family:Arial,&#39;Liberation Sans&#39;,&#39;DejaVu Sans&#3=
9;,sans-serif;line-height:12.8000001907349px;background-image:initial;backg=
round-repeat:initial"><tbody style=3D"margin:0px;padding:0px;border:0px;fon=
t-size:13px;vertical-align:baseline;background:transparent"><tr style=3D"ma=
rgin:0px;padding:0px;border:0px;font-size:13px;vertical-align:baseline;back=
ground:transparent"><td class=3D"" style=3D"padding:0px;border:0px;font-siz=
e:13px;vertical-align:baseline;background:transparent"><div style=3D"margin=
:0px;padding:0px;border:0px;font-size:13px;vertical-align:baseline;backgrou=
nd:transparent"><div class=3D"" itemprop=3D"text" style=3D"margin:0px 5px 5=
px 0px;padding:0px;border:0px;font-size:14px;vertical-align:baseline;word-w=
rap:break-word;width:660px;line-height:17.8048000335693px;background:transp=
arent"><p style=3D"margin:0px 0px 1em;padding:0px;border:0px;font-size:14px=
;vertical-align:baseline;clear:both;background:transparent"><span style=3D"=
font-size:14px;line-height:17.8048000335693px;background-color:transparent"=
>spark.cassandra.output.batch.size.rows=3D1</span></p><p style=3D"margin:0p=
x 0px 1em;padding:0px;border:0px;font-size:14px;vertical-align:baseline;cle=
ar:both;background:transparent"><span style=3D"font-size:14px;line-height:1=
7.8048000335693px;background-color:transparent">spark.cassandra.output.conc=
urrent.writes=3D1</span></p></div></div></td></tr></tbody></table></div><di=
v>







<p class=3D"">com.datastax.driver.core.exceptions.NoHostAvailableException:=
 All host(s) tried for query failed (tried: [] - use getErrors() for detail=
s)</p>
<p class=3D""><span class=3D"">	</span>at com.datastax.driver.core.RequestH=
andler.sendRequest(RequestHandler.java:108)</p>
<p class=3D""><span class=3D"">	</span>at com.datastax.driver.core.RequestH=
andler$1.run(RequestHandler.java:179)</p>
<p class=3D""><span class=3D"">	</span>at java.util.concurrent.ThreadPoolEx=
ecutor.runWorker(ThreadPoolExecutor.java:1145)</p>
<p class=3D""><span class=3D"">	</span>at java.util.concurrent.ThreadPoolEx=
ecutor$Worker.run(ThreadPoolExecutor.java:615)</p>
<p class=3D""><span class=3D"">	</span>at java.lang.Thread.run(Thread.java:=
745)</p><p class=3D"">Thanks</p><p class=3D"">Ankur</p></div></div>

--001a11c0dd5ceb2341050c43ab3a--