Mailing-List: contact user-help@livy.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@livy.incubator.apache.org
Content-Type: multipart/alternative;
 boundary="----sinikael-?=_1-15075510880290.7025099414745923"
From: Junaid Nasir <jnasir@an10.io>
To: user@livy.incubator.apache.org
Subject: Spark cassandra connector with livy
Message-Id: <ad566a08-6d8c-b852-7294-60e6ec2ff6e3@mixmax.com>
Date: Mon, 09 Oct 2017 12:11:27 +0000
MIME-Version: 1.0
archived-at: Mon, 09 Oct 2017 12:11:35 -0000

------sinikael-?=_1-15075510880290.7025099414745923
Content-Type: text/plain; format=flowed
Content-Transfer-Encoding: quoted-printable

Hi,
How can I include Cassandra-connect-package  to Livy spark session?
I use the following spark-submit command/spark-submit --master
spark://10.128.1.1:7077 --packages
datastax:spark-cassandra-connector:2.0.=
1-s_2.11 --conf
spark.cassandra.connection.host=3D"10.128.1.1,10.128.1.2,10=
.128.1.3"
how can i translate it to livy's session request or add this to =
livy conf file?
Also how to provide list of string and Map of key=3Dval as =
mentioned in livy's
documentation
Regards,Junaid Nasir
------sinikael-?=_1-15075510880290.7025099414745923
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www=
.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns=3D"http://www.=
w3.org/1999/xhtml" xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office"> <head> <meta =
name=3D"viewport" content=3D"width=3Ddevice-width,initial-scale=3D1"> <!=
--[if gte mso 9]>
    <xml>
      <o:OfficeDocumentSettings>
        <o:AllowPNG/>
        <o:PixelsPerInch>96</o:PixelsPerInch>
     </o:OfficeDocumentSettings>
    </xml>
    <![endif]--> <style =
type=3D"text/css">* a:hover{cursor:pointer;}</style> <style>body =
{-webkit-animation:bugfix infinite 1s;}@-webkit-keyframes bugfix {from =
{position:relative;}to {position:relative;}}</style> </head> <body =
style=3D"word-wrap:normal;word-break:break-word"> <style>a =
{word-wrap:normal;word-break:break-word;}.background-contain =
{background-size:contain;}@media only screen and (max-width:600px) {.=
container {-webkit-text-size-adjust:none !important;}.container,.=
palm-one-whole {width:100% !important;min-width:100% !important;}.=
palm-one-half {width:50% !important;min-width:50% !important;box-sizing:bor=
der-box;}blockquote .container,blockquote .container div,blockquote .=
container table {width:auto !important;min-width:0 !=
important;position:relative !important;}img {max-width:100%;}.border-outer,=
.border-middle,.border-inner,.inner,[title=3D"separator"] {width:100% !=
important;}.innercell {padding:8px !important;}.palm-block {display:block !=
important;}td.palm-one-whole {display:inline-block !important;padding:0;}td=
.palm-one-whole:first-child:not(:only-child) {margin-bottom:16px;}td.=
hostname {padding-top:3px !important;}}@media only screen and =
(min-width:601px) {.preview-card {max-width:600px !important;}}@media only =
screen and (min-device-width :320px) and (max-device-width :568px),only =
screen and (min-device-width :768px) and (max-device-width :1024px),only =
screen and (max-device-width:640px),only screen and =
(max-device-width:667px),only screen and (max-width:480px){.container =
{width:100% !important;min-width:100% !important;}.p,.small,li,=
font[size=3D"2"],font[size=3D"3"] {font-size:1em !important;}}@media only =
screen and (min-device-width :320px) and (max-device-width :568px),only =
screen and (min-device-width :768px) and (max-device-width :1024px),only =
screen and (min-device-width :1224px)  {.message-wrapper {padding-top:6px;}=
.apple-only[style] {display:block !important;max-height:none !=
important;line-height:normal !important;overflow:visible !=
important;height:auto !important;width:100% !important;position:relative !=
important;}.no-apple {display:none !important;}form =
{font-size:inherit;}input[type=3D"text"] {height:43px;padding-left:4px !=
important;}button:hover {cursor:pointer;}}@media only screen and =
(min-device-width :1224px)  {.apple-mail-form {display:block !=
important;background-color:white !important;}}* [office365] .=
outlook-com-hidden {display:none !important;}* [office365] .=
outlook-com-button {display:block;}* [office365] .outlook-com-only =
{display:block !important;max-height:none !important;line-height:normal !=
important;overflow:visible !important;height:auto !important;width:100% !=
important;position:relative !important;}.ExternalClass {width:100%;}.=
ExternalClass .outlook-com-button {display:block;}.ExternalClass button =
{height:auto;}.ExternalClass .outlook-com-hidden {display:none !important;}=
.ExternalClass .outlook-com-only {display:block !important;max-height:none =
!important;line-height:normal !important;overflow:visible !=
important;height:auto !important;width:100% !important;position:relative !=
important;}.ExternalClass .ecxlabels {display:none !important;}.=
ExternalClass .ecxlabels {display:none !important;}.ExternalClass .ecxarrow=
 {display:none !important;}.ExternalClass cite >div + div {padding:0 0 4px =
0;}.ExternalClass .h1 {padding-bottom:5px;}.ExternalClass .h2 =
{padding-bottom:5px;}.ExternalClass .h3 {padding-bottom:5px;}.ExternalClass=
 [lang=3D"brand-pinterest"] {width:280px !important;}</style> <!--[if (gte =
mso 9)|(IE)]>
   =20
    <style>
      a, body {
        font-family: =
'Calibri', Arial, sans-serif;
      }
   =20
      img {
        border: none !important;
        -ms-interpolation-mode:bicubic;
      }
   =20
      td {
        mso-line-height-rule:exactly !important;
      }
   =20
      .mso-card-inner table {
        border-collapse: =
collapse !important;
        mso-table-lspace:0pt;
        =
mso-table-rspace:0pt;
        vertical-align: top;
      }
   =20
      .outlook-com-only {
        display: none !important;
        font-size: 0 !important;
      }
   =20
      #mso-one-whole {
        width: 100% !important;
      }
   =20
   =20
   =20
        .border-outer,
        .border-middle,
        .border-inner {
          border: none !important;
        }
   =20
        .border-middle,
        .border-inner {
          width: 100% !important;
        }
   =20
        .mso-border-outer,
        .mso-border-middle,
        .mso-border-inner {
          padding: 1px;
        }
   =20
        .mso-border-outer { background-color: rgb(245, 255, 255); }
        .mso-border-middle { background-color: rgb(223, 246, 255); }
        .mso-border-inner { background-color: rgb(153, 176, 225); }
   =20
    </style>
   =20
    <![endif]--> <table class=3D"container" =
lang=3D"container" dir=3D"ltr" border=3D"0" cellpadding=3D"0" =
cellspacing=3D"0" valign=3D"top" style=3D"width:100%;margin-top:6px"> <tr> =
<td valign=3D"top" class=3D"message-wrapper" style=3D"line-height:1.=
31;color:#222;font-family:arial,sans-serif"> <!--[if mso]><table  =
border=3D"0" cellpadding=3D"0" cellspacing=3D"0" valign=3D"top" =
style=3D"border-collapse:separate;"><tr><td valign=3D"top"><![endif]--> =
<div>Hi,</div><div><br></div><div>How can I include <a =
href=3D"https://github.com/datastax/spark-cassandra-connector/">Cassandra-c=
onnect-package</a> to Livy spark session?</div><div><br></div><div>I use =
the following spark-submit command=C2=A0</div><blockquote =
style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid =
#cccccc;padding-left:1ex"><div>/spark-submit --master spark://10.128.1.=
1:7077 --packages datastax:spark-cassandra-connector:2.0.1-s_2.11 --conf =
spark.cassandra.connection.host=3D&quot;10.128.1.1,10.128.1.2,10.128.1.=
3&quot;</div></blockquote><div><br></div><div>how can i translate it to =
livy's session request or add this to livy conf file?=
</div><div><br></div><div>Also how to provide list of string and Map of =
key=3Dval as mentioned in <a href=3D"https://livy.incubator.apache.=
org/docs/latest/rest-api.html#session">livy's documentation</a></div><div><=
br></div><div>Regards,</div><div>Junaid Nasir</div><div></div><img =
align=3D"left" width=3D"0" height=3D"0" style=3D"border:0;width:0px;height:=
0px" src=3D"https://track.mixmax.com/api/track/v2/9dznYnlhv2b3ad3kb/gIvlmLw=
EjbhBkcpNXYupmI/IyZy9mLlh2YhBXYuI3b0FmY1Nmbp5Se2lGbAJXZzVnI" alt=3D""> <!=
--[if mso]></td></tr></table><![endif]--> </td> </tr> </table> </body> =
</html>=20
------sinikael-?=_1-15075510880290.7025099414745923--