Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CAHfzKEreehBtBZ_5PFyHAC1PVLrbuRANV_rkjx5ad=ZUhcOtXw@mail.gmail.com>
References: 
 <CAHfzKEreehBtBZ_5PFyHAC1PVLrbuRANV_rkjx5ad=ZUhcOtXw@mail.gmail.com>
Date: Fri, 8 Apr 2016 07:06:36 -0400
Message-ID: 
 <CAN=qJ2AmvH0z+LUO5hKXQ_J=-SgEHWdVkSzHJLtwfozMezPRoA@mail.gmail.com>
Subject: Re: [HELP:]Save Spark Dataframe in Phoenix Table
From: Josh Mahonin <jmahonin@gmail.com>
To: user@phoenix.apache.org
Cc: "user @spark" <user@spark.apache.org>, user@hadoop.apache.org,
 user@hbase.apache.org
Content-Type: multipart/alternative; boundary=94eb2c04f3a4474c3e052ff7303e

--94eb2c04f3a4474c3e052ff7303e
Content-Type: text/plain; charset=UTF-8

Hi Divya,

That's strange. Are you able to post a snippet of your code to look at? And
are you sure that you're saving the dataframes as per the docs (
https://phoenix.apache.org/phoenix_spark.html)?

Depending on your HDP version, it may or may not actually have
phoenix-spark support. Double-check that your Spark configuration is setup
with the right worker/driver classpath settings. and that the phoenix JARs
contain the necessary phoenix-spark classes
(e.g. org.apache.phoenix.spark.PhoenixRelation). If not, I suggest
following up with Hortonworks.

Josh


On Fri, Apr 8, 2016 at 1:22 AM, Divya Gehlot <divya.htconex@gmail.com>
wrote:

> Hi,
> I hava a Hortonworks Hadoop cluster having below Configurations :
> Spark 1.5.2
> HBASE 1.1.x
> Phoenix 4.4
>
> I am able to connect to Phoenix through JDBC connection and able to read
> the Phoenix tables .
> But while writing the data back to Phoenix table
> I am getting below error :
>
> org.apache.spark.sql.AnalysisException:
> org.apache.phoenix.spark.DefaultSource does not allow user-specified
> schemas.;
>
> Can any body help in resolving the above errors or any other solution of
> saving Spark Dataframes to Phoenix.
>
> Would really appareciate the help.
>
> Thanks,
> Divya
>

--94eb2c04f3a4474c3e052ff7303e
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Divya,<div><br></div><div>That&#39;s strange. Are you a=
ble to post a snippet of your code to look at? And are you sure that you=
9;re saving the dataframes as per the docs (<a href=3D"https://phoenix.apac=
he.org/phoenix_spark.html">https://phoenix.apache.org/phoenix_spark.html</a=
>)?<br></div><div><br></div><div>Depending on your HDP version, it may or m=
ay not actually have phoenix-spark support. Double-check that your Spark co=
nfiguration is setup with the right worker/driver classpath settings. and t=
hat the phoenix JARs contain the necessary phoenix-spark classes (e.g.=C2=
=A0org.apache.phoenix.spark.PhoenixRelation). If not, I suggest following u=
p with Hortonworks.</div><div><br>Josh</div><div><br><br></div></div><div c=
lass=3D"gmail_extra"><br><div class=3D"gmail_quote">On Fri, Apr 8, 2016 at =
1:22 AM, Divya Gehlot <span dir=3D"ltr">&lt;<a href=3D"mailto:divya.htconex=
@gmail.com" target=3D"_blank">divya.htconex@gmail.com</a>&gt;</span> wrote:=
<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-lef=
t:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div>I hava a Horton=
works Hadoop cluster having below Configurations :</div><div>Spark 1.5.2</d=
iv><div>HBASE 1.1.x</div><div>Phoenix 4.4=C2=A0</div><div><br></div><div>I =
am able to connect to Phoenix through JDBC connection and able to read the =
Phoenix tables .</div><div>But while writing the data back to Phoenix table=
=C2=A0</div><div>I am getting below error :</div><div><div><br></div><div>o=
rg.apache.spark.sql.AnalysisException: org.apache.phoenix.spark.DefaultSour=
ce does not allow user-specified schemas.;</div></div><div><br></div><div>C=
an any body help in resolving the above errors or any other solution of sav=
ing Spark Dataframes to Phoenix.</div><div><br></div><div>Would really appa=
reciate the help.</div><div><br></div><div>Thanks,</div><div>Divya=C2=A0</d=
iv></div>
</blockquote></div><br></div>

--94eb2c04f3a4474c3e052ff7303e--