Return-Path: X-Original-To: apmail-crunch-user-archive@www.apache.org Delivered-To: apmail-crunch-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5D9D510FDD for ; Wed, 12 Mar 2014 16:03:26 +0000 (UTC) Received: (qmail 38177 invoked by uid 500); 12 Mar 2014 16:03:24 -0000 Delivered-To: apmail-crunch-user-archive@crunch.apache.org Received: (qmail 38141 invoked by uid 500); 12 Mar 2014 16:03:24 -0000 Mailing-List: contact user-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@crunch.apache.org Delivered-To: mailing list user@crunch.apache.org Received: (qmail 38128 invoked by uid 99); 12 Mar 2014 16:03:23 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Mar 2014 16:03:23 +0000 X-ASF-Spam-Status: No, hits=4.3 required=5.0 tests=HTML_MESSAGE,HTTP_ESCAPED_HOST,SPF_PASS,URI_NOVOWEL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of prvs=11486d9dd0=nbarry@cerner.com designates 159.140.193.22 as permitted sender) Received: from [159.140.193.22] (HELO PPLS5MAIL1.cernercloud.com) (159.140.193.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Mar 2014 16:03:17 +0000 Received: from pps.filterd (PPLS5MAIL1.cernercloud.com [127.0.0.1]) by PPLS5MAIL1.cernercloud.com (8.14.7/8.14.7) with SMTP id s2CFxpOg031739 for ; Wed, 12 Mar 2014 11:02:55 -0500 Received: from cernmsgls5hub2.cerner.net ([170.71.96.37]) by PPLS5MAIL1.cernercloud.com with ESMTP id 1jjtkjg0r9-20 for ; Wed, 12 Mar 2014 11:02:55 -0500 Received: from CERNMSGLS5MB5A.cerner.net ([169.254.2.232]) by CERNMSGLS5HUB2.cerner.net ([170.71.96.37]) with mapi id 14.03.0174.001; Wed, 12 Mar 2014 10:57:47 -0500 From: "Barry,Nathan" To: "user@crunch.apache.org" Subject: Re: convert a scrunch.PCollection to a crunch.PCollection ? Thread-Topic: convert a scrunch.PCollection to a crunch.PCollection ? Thread-Index: AQHPPgeUjyiLBHU+nkeVQox4Poa+HZrd646A//+v/YA= Date: Wed, 12 Mar 2014 15:57:46 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.9.131030 x-originating-ip: [39.250.140.25] Content-Type: multipart/alternative; boundary="_000_CF45EE0B1830Enbarrycernercom_" MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.11.87,1.0.14,0.0.0000 definitions=2014-03-12_06:2014-03-12,2014-03-12,1970-01-01 signatures=0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CF45EE0B1830Enbarrycernercom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable _doh_ Missed that one From: Josh Wills > Reply-To: "user@crunch.apache.org" > Date: Wednesday, March 12, 2014 at 10:44 AM To: "user@crunch.apache.org" > Subject: Re: convert a scrunch.PCollection to a crunch.PCollection ? Scrunch PCollections have a member called "native" that returns the underly= ing Java PCollection. I think we could allow the conversion to happen autom= atically by updating o.a.c.s.Conversions to include implicit methods for go= ing _back_ from a Scrunch PCollection to a Java PCollection (right now, onl= y the Java -> Scala methods are provided.) On Wed, Mar 12, 2014 at 8:27 AM, Barry,Nathan > wrote: Hi I'm migrating some code from crunch to scrunch and I'm running into an issu= e leveraging a crunch based API that takes a crunch PCollection as a parame= ter but I have a scrunch PCollection which results in compilation errors wh= en trying to pass the scrunch Pcollection into the API What am I missing? I _think_ I have the proper conversion imports in place= . [ERROR] found : org.apache.crunch.scrunch.PCollection[org.apache.hadoop.= hbase.client.Put] [ERROR] required: org.apache.crunch.PCollection[org.apache.hadoop.hbase.cl= ient.Put] Thanks, Nathan CONFIDENTIALITY NOTICE This message and any included attachments are from C= erner Corporation and are intended only for the addressee. The information = contained in this message is confidential and may constitute inside or non-= public information under international, federal, or state securities laws. = Unauthorized forwarding, printing, copying, distribution, or use of such in= formation is strictly prohibited and may be unlawful. If you are not the ad= dressee, please promptly delete this message and notify the sender of the d= elivery error by e-mail or you may call Cerner's corporate offices in Kansa= s City, Missouri, U.S.A at (+1) (816)221-1024. -- Director of Data Science Cloudera Twitter: @josh_wills --_000_CF45EE0B1830Enbarrycernercom_ Content-Type: text/html; charset="us-ascii" Content-ID: <8B1A5E3C0BCB3343B58D441FDA38E5F2@cerner.com> Content-Transfer-Encoding: quoted-printable
_doh_

Missed that one

From: Josh Wills <jwills@cloudera.com>
Reply-To: "user@crunch.apache.org" <user@crunch.apache.org>
Date: Wednesday, March 12, 2014 at = 10:44 AM
To: "user@crunch.apache.org" <user@crunch.apache.org>
Subject: Re: convert a scrunch.PCol= lection to a crunch.PCollection ?

Scrunch PCollections have a member called "native&quo= t; that returns the underlying Java PCollection. I think we could allow the= conversion to happen automatically by updating o.a.c.s.Conversions to incl= ude implicit methods for going _back_ from a Scrunch PCollection to a Java PCollection (right now, only the Java -> = Scala methods are provided.)


On Wed, Mar 12, 2014 at 8:27 AM, Barry,Nathan <NBARRY@cerner.co= m> wrote:
Hi

I'm migrating some code from crunch to scrunch and I'm running into an issu= e leveraging a crunch based API that takes a crunch PCollection as a parame= ter but I have a scrunch PCollection which results in compilation errors wh= en trying to pass the scrunch Pcollection into the API

What am I missing?  I _think_ I have the proper conversion imports in = place.

[ERROR]  found   : org.apache.crunch.scrunch.PCollect= ion[org.apache.hadoop.hbase.client.Put]
[ERROR]  required: org.apache.crunch.PCollection[org.apach= e.hadoop.hbase.client.Put]

Thanks,

Nathan

CONFIDENTIALITY NOTICE This message and any included attachments are f= rom Cerner Corporation and are intended only for the addressee. The informa= tion contained in this message is confidential and may constitute inside or= non-public information under international, federal, or state securities laws. Unauthorized forwarding, printing, copy= ing, distribution, or use of such information is strictly prohibited and ma= y be unlawful. If you are not the addressee, please promptly delete this me= ssage and notify the sender of the delivery error by e-mail or you may call Cerner's corporate offices in Kan= sas City, Missouri, U.S.A at (+1) (816)221-1024.



--
Director of Data Science
Twitter: @josh_wills
 --_000_CF45EE0B1830Enbarrycernercom_--