Mailing-List: contact user-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@crunch.apache.org
Received-SPF: pass (athena.apache.org: domain of jwills@cloudera.com
 designates 209.85.216.51 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <CF45E70A.182F2%nbarry@cerner.com>
References: <CF45E70A.182F2%nbarry@cerner.com>
From: Josh Wills <jwills@cloudera.com>
Date: Wed, 12 Mar 2014 08:44:05 -0700
Message-ID: 
 <CAH29n6PWccbv=VmR_1_zdzcw-9KupugoR88imfpjcP5TY+HksQ@mail.gmail.com>
Subject: Re: convert a scrunch.PCollection to a crunch.PCollection ?
To: user@crunch.apache.org
Content-Type: multipart/alternative; boundary=047d7bdc80d81a24ca04f46ab670

--047d7bdc80d81a24ca04f46ab670
Content-Type: text/plain; charset=ISO-8859-1

Scrunch PCollections have a member called "native" that returns the
underlying Java PCollection. I think we could allow the conversion to
happen automatically by updating o.a.c.s.Conversions to include implicit
methods for going _back_ from a Scrunch PCollection to a Java PCollection
(right now, only the Java -> Scala methods are provided.)


On Wed, Mar 12, 2014 at 8:27 AM, Barry,Nathan <NBARRY@cerner.com> wrote:

>  Hi
>
>  I'm migrating some code from crunch to scrunch and I'm running into an
> issue leveraging a crunch based API that takes a crunch PCollection as a
> parameter but I have a scrunch PCollection which results in compilation
> errors when trying to pass the scrunch Pcollection into the API
>
>  What am I missing?  I _think_ I have the proper conversion imports in
> place.
>
>  [ERROR]  found   : org.apache.crunch.scrunch.
> PCollection[org.apache.hadoop.hbase.client.Put]
> [ERROR]  required: org.apache.crunch.PCollection[org.apache.hadoop.hbase.
> client.Put]
>
>  Thanks,
>
>  Nathan
>
>   CONFIDENTIALITY NOTICE This message and any included attachments are
> from Cerner Corporation and are intended only for the addressee. The
> information contained in this message is confidential and may constitute
> inside or non-public information under international, federal, or state
> securities laws. Unauthorized forwarding, printing, copying, distribution,
> or use of such information is strictly prohibited and may be unlawful. If
> you are not the addressee, please promptly delete this message and notify
> the sender of the delivery error by e-mail or you may call Cerner's
> corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.
>


-- 
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>

--047d7bdc80d81a24ca04f46ab670
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Scrunch PCollections have a member called &quot;native&quo=
t; that returns the underlying Java PCollection. I think we could allow the=
 conversion to happen automatically by updating o.a.c.s.Conversions to incl=
ude implicit methods for going _back_ from a Scrunch PCollection to a Java =
PCollection (right now, only the Java -&gt; Scala methods are provided.)</d=
iv>

<div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Wed, Mar 1=
2, 2014 at 8:27 AM, Barry,Nathan <span dir=3D"ltr">&lt;<a href=3D"mailto:NB=
ARRY@cerner.com" target=3D"_blank">NBARRY@cerner.com</a>&gt;</span> wrote:<=
br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left=
:1px #ccc solid;padding-left:1ex">


<div style=3D"font-size:14px;font-family:Calibri,sans-serif;word-wrap:break=
-word">
<div><span style=3D"color:rgb(34,34,34);font-size:13.333333969116211px;font=
-family:arial,sans-serif">Hi</span>
<div style=3D"color:rgb(34,34,34);font-size:13.333333969116211px;font-famil=
y:arial,sans-serif">
<br>
</div>
<div style=3D"color:rgb(34,34,34);font-size:13.333333969116211px;font-famil=
y:arial,sans-serif">
I&#39;m migrating some code from crunch to scrunch and I&#39;m running into=
 an issue leveraging a crunch based API that takes a crunch PCollection as =
a parameter but I have a scrunch PCollection which results in compilation e=
rrors when trying to pass the scrunch Pcollection
 into the API</div>
<div style=3D"color:rgb(34,34,34);font-size:13.333333969116211px;font-famil=
y:arial,sans-serif">
<br>
</div>
<div style=3D"color:rgb(34,34,34);font-size:13.333333969116211px;font-famil=
y:arial,sans-serif">
What am I missing? =A0I _think_ I have the proper conversion imports in pla=
ce.<br>
<div><br>
</div>
<div>
<div>[ERROR] =A0found =A0 : org.apache.crunch.scrunch.<u></u>PCollection[or=
g.apache.hadoop.<u></u>hbase.client.Put]</div>
<div>[ERROR] =A0required: org.apache.crunch.PCollection[<u></u>org.apache.h=
adoop.hbase.<u></u>client.Put]</div>
</div>
<div><br>
</div>
<div>Thanks,</div>
<div><br>
</div>
<div>Nathan</div>
<div><br>
</div>
</div>
</div>

<div>
CONFIDENTIALITY NOTICE This message and any included attachments are from C=
erner Corporation and are intended only for the addressee. The information =
contained in this message is confidential and may constitute inside or non-=
public information under international, federal, or state securities laws. =
Unauthorized forwarding, printing, copying, distribution, or use of such in=
formation is strictly prohibited and may be unlawful. If you are not the ad=
dressee, please promptly delete this message and notify the sender of the d=
elivery error by e-mail or you may call Cerner&#39;s corporate offices in K=
ansas City, Missouri, U.S.A at <a href=3D"tel:%28%2B1%29%20%28816%29221-102=
4" value=3D"+18162211024" target=3D"_blank">(+1) (816)221-1024</a>.<br>


</div></div>

</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div>Directo=
r of Data Science</div><div><a href=3D"http://www.cloudera.com" target=3D"_=
blank">Cloudera</a></div><div>Twitter: <a href=3D"http://twitter.com/josh_w=
ills" target=3D"_blank">@josh_wills</a></div>


</div>

--047d7bdc80d81a24ca04f46ab670--