Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
MIME-Version: 1.0
In-Reply-To: <DC90B1F5-4167-4AFA-BB12-218F45F5E657@hortonworks.com>
References: <CAC06LGb5TTbMVw-YjODYpSc0uSpP3ZT=YZpxTiO9uX0PCMPjQQ@mail.gmail.com>
 <CAPXnLzdDYUAtB5QHD32S3ECUrqfSmNds+6ZBg8CGk0bQpxvO-w@mail.gmail.com>
 <CAC06LGYKSfLKE_LH-Jpi=f_+DRZtQAvNwRJoXqQwxwB8XFXQbg@mail.gmail.com> <DC90B1F5-4167-4AFA-BB12-218F45F5E657@hortonworks.com>
From: Stephen Sprague <spragues@gmail.com>
Date: Tue, 26 Sep 2017 20:23:36 -0700
Message-ID: <CAC06LGYuteHd5JGyz3fDGYu+RMAkLu2GTnRbao08Sx=h3uQ43A@mail.gmail.com>
Subject: Re: hive on spark - why is it so hard?
To: "user@hive.apache.org" <user@hive.apache.org>
Content-Type: multipart/alternative; boundary="94eb2c0d4b667151fc055a2352ac"
archived-at: Wed, 27 Sep 2017 03:24:02 -0000

--94eb2c0d4b667151fc055a2352ac
Content-Type: text/plain; charset="UTF-8"

oh. i missed Gopal's reply.  oy... that sounds foreboding.  I'll keep you
posted on my progress.

On Tue, Sep 26, 2017 at 4:40 PM, Gopal Vijayaraghavan <gopalv@apache.org>
wrote:

> Hi,
>
> > org.apache.hadoop.hive.ql.parse.SemanticException: Failed to get a
> spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed
> to create spark client.
>
> I get inexplicable errors with Hive-on-Spark unless I do a three step
> build.
>
> Build Hive first, use that version to build Spark, use that Spark version
> to rebuild Hive.
>
> I have to do this to make it work because Spark contains Hive jars and
> Hive contains Spark jars in the class-path.
>
> And specifically I have to edit the pom.xml files, instead of passing in
> params with -Dspark.version, because the installed pom files don't get
> replacements from the build args.
>
> Cheers,
> Gopal
>
>
>

--94eb2c0d4b667151fc055a2352ac
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:courier =
new,monospace">oh. i missed Gopal&#39;s reply. =C2=A0oy... that sounds fore=
boding.=C2=A0 I&#39;ll keep you posted on my progress.</div></div><div clas=
s=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Sep 26, 2017 at 4:=
40 PM, Gopal Vijayaraghavan <span dir=3D"ltr">&lt;<a href=3D"mailto:gopalv@=
apache.org" target=3D"_blank">gopalv@apache.org</a>&gt;</span> wrote:<br><b=
lockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px =
#ccc solid;padding-left:1ex">Hi,<br>
<span class=3D""><br>
&gt; org.apache.hadoop.hive.ql.<wbr>parse.SemanticException: Failed to get =
a spark session: org.apache.hadoop.hive.ql.<wbr>metadata.HiveException: Fai=
led to create spark client.<br>
<br>
</span>I get inexplicable errors with Hive-on-Spark unless I do a three ste=
p build.<br>
<br>
Build Hive first, use that version to build Spark, use that Spark version t=
o rebuild Hive.<br>
<br>
I have to do this to make it work because Spark contains Hive jars and Hive=
 contains Spark jars in the class-path.<br>
<br>
And specifically I have to edit the pom.xml files, instead of passing in pa=
rams with -Dspark.version, because the installed pom files don&#39;t get re=
placements from the build args.<br>
<br>
Cheers,<br>
Gopal<br>
<br>
<br>
</blockquote></div><br></div>

--94eb2c0d4b667151fc055a2352ac--