Mailing-List: contact dev-help@spark.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
Reply-To: shivaram@eecs.berkeley.edu
In-Reply-To: 
 <CA+0XtC-WH-g42=SrcQgrVeCfajG8RoWG+u6Rv2PNo-nZJ5y=Dw@mail.gmail.com>
References: 
 <CA+0XtC-WH-g42=SrcQgrVeCfajG8RoWG+u6Rv2PNo-nZJ5y=Dw@mail.gmail.com>
From: Shivaram Venkataraman <shivaram@eecs.berkeley.edu>
Date: Tue, 23 Jun 2015 13:46:41 -0700
Message-ID: 
 <CAKx7Bf9YZYP-=5vovjFcO0pkxOje0nkAP2mY+OdbXi0=98QN1g@mail.gmail.com>
Subject: Re: how can I write a language "wrapper"?
To: "Vasili I. Galchin" <vigalchin@gmail.com>
Cc: "dev@spark.apache.org" <dev@spark.apache.org>
Content-Type: multipart/alternative; boundary=001a11c34b4ef30cb10519357d25

--001a11c34b4ef30cb10519357d25
Content-Type: text/plain; charset=UTF-8

Every language has its own quirks / features -- so I don't think there
exists a document on how to go about doing this for a new language. The
most related write up I know of is the wiki page on PySpark internals
https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals written
by Josh Rosen -- It covers some of the issues like closure capture,
serialization, JVM communication that you'll need to handle for a new
language.

Thanks
Shivaram

On Tue, Jun 23, 2015 at 1:35 PM, Vasili I. Galchin <vigalchin@gmail.com>
wrote:

> Hello,
>
>       I want to add language support for another language(other than
> Scala, Java et. al.). Where is documentation that explains to provide
> support for a new language?
>
> Thank you,
>
> Vasili
>

--001a11c34b4ef30cb10519357d25
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Every language has its own quirks / features -- so I don&#=
39;t think there exists a document on how to go about doing this for a new =
language. The most related write up I know of is the wiki page on PySpark i=
nternals=C2=A0<a href=3D"https://cwiki.apache.org/confluence/display/SPARK/=
PySpark+Internals">https://cwiki.apache.org/confluence/display/SPARK/PySpar=
k+Internals</a> written by Josh Rosen -- It covers some of the issues like =
closure capture, serialization, JVM communication that you&#39;ll need to h=
andle for a new language.=C2=A0<div><br></div><div>Thanks</div><div>Shivara=
m</div></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On T=
ue, Jun 23, 2015 at 1:35 PM, Vasili I. Galchin <span dir=3D"ltr">&lt;<a hre=
f=3D"mailto:vigalchin@gmail.com" target=3D"_blank">vigalchin@gmail.com</a>&=
gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 =
0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello,<div><br></div><d=
iv>=C2=A0 =C2=A0 =C2=A0 I want to add language support for another language=
(other than Scala, Java et. al.). Where is documentation that explains to p=
rovide support for a new language?</div><div><br></div><div>Thank you,</div=
><div><br></div><div>Vasili</div>
</blockquote></div><br></div>

--001a11c34b4ef30cb10519357d25--