Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
MIME-Version: 1.0
Date: Fri, 20 Nov 2015 15:05:30 +0530
Message-ID: 
 <CA+g1R4DG6bi4BUGt3NRrkdYq7Q3XYpVChsZbbMhurdohmJnWpw@mail.gmail.com>
Subject: Hive on Spark - Hadoop 2 - Installation - Ubuntu
From: Dasun Hegoda <dasunhegoda@gmail.com>
To: user@hive.apache.org
Content-Type: multipart/alternative; boundary=001a114063fea8f2ff0524f59879

--001a114063fea8f2ff0524f59879
Content-Type: text/plain; charset=UTF-8

Hi,

What I'm planning to do is develop a reporting platform using existing
data. I have an existing RDBMS which has large number of records. So I'm
using. (
http://stackoverflow.com/questions/33635234/hadoop-2-7-spark-hive-jasperreports-scoop-architecuture
)

 - Scoop - Extract data from RDBMS to Hadoop
 - Hadoop - Storage platform -> *Deployment Completed*
 - Hive - Datawarehouse
 - Spark - Read time processing -> *Deployment Completed*

I'm planning to deploy Hive on Spark but I can't find the installation
steps. I tried to read the official '[Hive on Spark][1]' guide but it has
problems. As an example it says under 'Configuring Yarn'
`yarn.resourcemanager.scheduler.class=org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler`
but does not imply where should I do it. Also as per the guide
configurations are set in the Hive runtime shell which is not permanent
according to my knowledge.

Given that I read [this][2] but it does not have any steps.

Please provide me the steps to run Hive on Spark on Ubuntu as a production
system?


  [1]:
https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started
  [2]:
http://stackoverflow.com/questions/26018306/how-to-configure-hive-to-use-spark

-- 
Regards,
Dasun Hegoda, Software Engineer
www.dasunhegoda.com | dasunhegoda@gmail.com

--001a114063fea8f2ff0524f59879
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div><br></div><div><div>What I&#39;m planning to do is=
 develop a reporting platform using existing data. I have an existing RDBMS=
 which has large number of records. So I&#39;m using. (<a href=3D"http://st=
ackoverflow.com/questions/33635234/hadoop-2-7-spark-hive-jasperreports-scoo=
p-architecuture">http://stackoverflow.com/questions/33635234/hadoop-2-7-spa=
rk-hive-jasperreports-scoop-architecuture</a>)</div><div><br></div><div>=C2=
=A0- Scoop - Extract data from RDBMS to Hadoop</div><div>=C2=A0- Hadoop - S=
torage platform -&gt; *Deployment Completed*</div><div>=C2=A0- Hive - Dataw=
arehouse</div><div>=C2=A0- Spark - Read time processing -&gt; *Deployment C=
ompleted*</div><div><br></div><div>I&#39;m planning to deploy Hive on Spark=
 but I can&#39;t find the installation steps. I tried to read the official =
&#39;[Hive on Spark][1]&#39; guide but it has problems. As an example it sa=
ys under &#39;Configuring Yarn&#39; `yarn.resourcemanager.scheduler.class=
=3Dorg.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairSchedul=
er` but does not imply where should I do it. Also as per the guide configur=
ations are set in the Hive runtime shell which is not permanent according t=
o my knowledge.</div><div><br></div><div>Given that I read [this][2] but it=
 does not have any steps.</div><div><br></div><div>Please provide me the st=
eps to run Hive on Spark on Ubuntu as a production system?</div><div><br></=
div><div><br></div><div>=C2=A0 [1]: <a href=3D"https://cwiki.apache.org/con=
fluence/display/Hive/Hive+on+Spark%3A+Getting+Started">https://cwiki.apache=
.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started</a></div><div=
>=C2=A0 [2]: <a href=3D"http://stackoverflow.com/questions/26018306/how-to-=
configure-hive-to-use-spark">http://stackoverflow.com/questions/26018306/ho=
w-to-configure-hive-to-use-spark</a></div><div><br></div>-- <br><div class=
=3D"gmail_signature"><span><font color=3D"#888888">Regards,</font></span><d=
iv><font size=3D"4">Dasun Hegoda</font><span style=3D"color:rgb(136,136,136=
)">, Software Engineer=C2=A0=C2=A0</span><br style=3D"color:rgb(136,136,136=
)"><a href=3D"http://www.dasunhegoda.com/" target=3D"_blank">www.dasunhegod=
a.com</a><span style=3D"color:rgb(136,136,136)">=C2=A0| <a href=3D"mailto:d=
asunhegoda@gmail.com" target=3D"_blank">dasunhegoda@gmail.com</a></span></d=
iv></div>
</div></div>

--001a114063fea8f2ff0524f59879--