Mailing-List: contact user-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@crunch.apache.org
MIME-Version: 1.0
Date: Thu, 5 Nov 2015 11:04:26 -0800
Message-ID: 
 <CAMQQebA-mQDRYP-5eraz8tvSf4uGK=JsS1JD7W9CK1ubh6+V=g@mail.gmail.com>
Subject: Crunch Compatibility with Spark 1.5.0?
From: Jeff Quinn <jeff@nuna.com>
To: user@crunch.apache.org
Content-Type: multipart/alternative; boundary=001a113496b0ba896e0523cfcb94

--001a113496b0ba896e0523cfcb94
Content-Type: text/plain; charset=UTF-8

Hello,

I am wondering if it would be possible to run a Crunch SparkPipeline on
Spark 1.5.0? I see that currently Crunch is pinned to Spark 1.3.1 libs in
master, when I try to run on a yarn-master, Spark 1.5.0, using Crunch
0.13.0, I am seeing weird exceptions such as:
java.lang.ClassNotFoundException: com.google.protobuf_spark.GeneratedMessage

Appreciate any guidance.

Thanks!

Jeff

-- 
*DISCLAIMER:* The contents of this email, including any attachments, may 
contain information that is confidential, proprietary in nature, protected 
health information (PHI), or otherwise protected by law from disclosure, 
and is solely for the use of the intended recipient(s). If you are not the 
intended recipient, you are hereby notified that any use, disclosure or 
copying of this email, including any attachments, is unauthorized and 
strictly prohibited. If you have received this email in error, please 
notify the sender of this email. Please delete this and all copies of this 
email from your system. Any opinions either expressed or implied in this 
email and all attachments, are those of its author only, and do not 
necessarily reflect those of Nuna Health, Inc.

--001a113496b0ba896e0523cfcb94
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hello,<div><br></div><div>I am wondering if it would be po=
ssible to run a Crunch SparkPipeline on Spark 1.5.0? I see that currently C=
runch is pinned to Spark 1.3.1 libs in master, when I try to run on a yarn-=
master, Spark 1.5.0, using Crunch 0.13.0, I am seeing weird exceptions such=
 as: java.lang.ClassNotFoundException: com.google.protobuf_spark.GeneratedM=
essage</div><div><br></div><div>Appreciate any guidance.</div><div><br></di=
v><div>Thanks!</div><div><br></div><div>Jeff</div></div>

<br>
<font size=3D"2" color=3D"#808080"><b style=3D"font-family:Calibri,sans-ser=
if;background-color:rgb(255,255,255)">DISCLAIMER:</b><span style=3D"font-fa=
mily:Calibri,sans-serif;background-color:rgb(255,255,255)">=C2=A0The conten=
ts of this email, including any attachments, may contain information that i=
s confidential, proprietary in nature, protected health information (PHI), =
or otherwise protected by law from disclosure, and is solely for the use of=
 the intended recipient(s). If you are not the intended recipient, you are =
hereby notified that any use, disclosure or copying of this email, includin=
g any attachments, is unauthorized and strictly prohibited. If you have rec=
eived this email in error, please notify the sender of this email. Please d=
elete this and all copies of this email from your system. Any opinions eith=
er expressed or implied in this email and all attachments, are those of its=
 author only, and do not necessarily reflect those of Nuna Health, Inc.</sp=
an></font>
--001a113496b0ba896e0523cfcb94--