Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of kartik.sxn@gmail.com designates
 209.85.216.179 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <COL126-DS146CAD630D36FF9B04F93A98A80@phx.gbl>
References: 
 <CACeqxwQ7sMmo92RG=SFuuOhCHn2x1Rf=WvE1_9Hs38q-EBX+Kw@mail.gmail.com>
	<CALr1C9oYpmFZUnc1LK-aEtJxPGMBvqQZA7kxFbMk9+0egK=9qw@mail.gmail.com>
	<CACeqxwTcFqN6PJtz8kB9NHJts9L3a=HH-JDwjS+TL1cAWFRO3Q@mail.gmail.com>
	<COL126-DS146CAD630D36FF9B04F93A98A80@phx.gbl>
Date: Fri, 17 Oct 2014 11:12:51 -0700
Message-ID: 
 <CAN3VsJEWCFZJwTpgHdnGnpuGm_rXe8iZR=_nvfaCn3NBaGnTRw@mail.gmail.com>
Subject: Re: Spark vs Tez
From: kartik saxena <kartik.sxn@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7bdc78f82875820505a250ac

--047d7bdc78f82875820505a250ac
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I did a performance benchmark during my summer internship . I am currently
a grad student. Can't reveal much about the specific project but Spark is
still faster than around 4-5th iteration of Tez of the same query/dataset.
By Iteration I mean utilizing the "hot-container" property of Apache Tez  .
See latest release of Tez and some hortonworks tutorials on their website.

The only problem with Spark adoption is the steep learning curve of Scala ,
and understanding the API properly.

Thanks

On Fri, Oct 17, 2014 at 11:06 AM, Adaryl "Bob" Wakefield, MBA <
adaryl.wakefield@hotmail.com> wrote:

>   Does anybody have any performance figures on how Spark stacks up
> against Tez? If you don=E2=80=99t have figures, does anybody have an opin=
ion? Spark
> seems so popular but I=E2=80=99m not really seeing why.
> B.
>

--047d7bdc78f82875820505a250ac
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I did a performance benchmark during my summer internship =
. I am currently a grad student. Can&#39;t reveal much about the specific p=
roject but Spark is still faster than around 4-5th iteration of Tez of the =
same query/dataset. By Iteration I mean utilizing the &quot;hot-container&q=
uot; property of Apache Tez =C2=A0. See latest release of Tez and some hort=
onworks tutorials on their website.=C2=A0<div><br></div><div>The only probl=
em with Spark adoption is the steep learning curve of Scala , and understan=
ding the API properly.=C2=A0<br><div><br></div><div>Thanks<br><div class=3D=
"gmail_extra"><br><div class=3D"gmail_quote">On Fri, Oct 17, 2014 at 11:06 =
AM, Adaryl &quot;Bob&quot; Wakefield, MBA <span dir=3D"ltr">&lt;<a href=3D"=
mailto:adaryl.wakefield@hotmail.com" target=3D"_blank">adaryl.wakefield@hot=
mail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir=3D"ltr">
<div dir=3D"ltr">
<div style=3D"FONT-SIZE:12pt;FONT-FAMILY:&#39;Calibri&#39;;COLOR:#000000">
<div>Does anybody have any performance figures on how Spark stacks up again=
st=20
Tez? If you don=E2=80=99t have figures, does anybody have an opinion? Spark=
 seems so=20
popular but I=E2=80=99m not really seeing why.</div><span class=3D"HOEnZb">=
<font color=3D"#888888">
<div>B.</div></font></span></div></div></div>
</blockquote></div><br></div></div></div></div>

--047d7bdc78f82875820505a250ac--