Return-Path: X-Original-To: apmail-crunch-user-archive@www.apache.org Delivered-To: apmail-crunch-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9E95318699 for ; Thu, 5 Nov 2015 19:25:49 +0000 (UTC) Received: (qmail 70121 invoked by uid 500); 5 Nov 2015 19:25:49 -0000 Delivered-To: apmail-crunch-user-archive@crunch.apache.org Received: (qmail 70080 invoked by uid 500); 5 Nov 2015 19:25:49 -0000 Mailing-List: contact user-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@crunch.apache.org Delivered-To: mailing list user@crunch.apache.org Received: (qmail 70070 invoked by uid 99); 5 Nov 2015 19:25:49 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2015 19:25:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 11E5B180232 for ; Thu, 5 Nov 2015 19:25:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=nuna.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 23xjTP0Q6BTs for ; Thu, 5 Nov 2015 19:25:48 +0000 (UTC) Received: from mail-lb0-f173.google.com (mail-lb0-f173.google.com [209.85.217.173]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id B525820F4A for ; Thu, 5 Nov 2015 19:25:47 +0000 (UTC) Received: by lbbes7 with SMTP id es7so42759225lbb.2 for ; Thu, 05 Nov 2015 11:25:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nuna.com; s=nuna; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=dBfOnqkWUdO0k8lvEegR8HQQ/Jp/hvRcStsvwiF9IOk=; b=msEiqw0vL9nZVuolbSVgH8+ZfRnd6O6KPjRxkE3C0mGYHoY5JUWJ8R6tx7/haZxSYf DGPYqCt4mU5dRh/PJsRnmixVtm/i5NSb0SVVTkeAFGlv+2CDxPfGyMKe/ZhwGqTbF7yk wlbejz9Fo7NJkDudnjF3QqDtddL/Xs1gKlTvE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=dBfOnqkWUdO0k8lvEegR8HQQ/Jp/hvRcStsvwiF9IOk=; b=X8qP5jdcrygJvat+MCgyOx0nu5It0uyK2zblp8S/rU4+E4kH6WJS1VuuBGUqTEW0mg PJo8erIBzmk34DfCbV4oxc+PW0TmvvlBXZ9C39f9PASjUx2t6Ajr3z/BrBmM1yYCpv+v GNKooHr22trBT4sYhon3B9+J3URwuMlju+wprIbBDUmYKyniiepisWEVx/TTHhcVow6o lZyR8N/Vzkarz9vLBRLSrHrDUM6V2L9laraTXjJArdWr5nVEkDqUlvEeKL2r4poF74MT 3IMY7lzW+aJcRL8iOjCq4Jtns1CtuGY4xkvLo/dcCju2pp7gQbo9he6/tpeLMrNW1DWn gtrw== X-Gm-Message-State: ALoCoQmfmWux2+qejd8uG3HODS0V369IFHjNCnDlhp7JAAGbi1Z3gNDIL8BZVDadoPSyFRvnYLB3IluBDVFR8X9fKxsjVXcpkc/gCF6IUk9WfbctbRfN3AYaqU67oRj6n3o5EN0mi9w1 MIME-Version: 1.0 X-Received: by 10.112.11.231 with SMTP id t7mr4772202lbb.13.1446751545966; Thu, 05 Nov 2015 11:25:45 -0800 (PST) Received: by 10.114.10.232 with HTTP; Thu, 5 Nov 2015 11:25:45 -0800 (PST) In-Reply-To: References: Date: Thu, 5 Nov 2015 11:25:45 -0800 Message-ID: Subject: Re: Crunch Compatibility with Spark 1.5.0? From: Jeff Quinn To: user@crunch.apache.org Content-Type: multipart/alternative; boundary=001a11c3aa1cf9de700523d01718 --001a11c3aa1cf9de700523d01718 Content-Type: text/plain; charset=UTF-8 Thanks Josh! FWIW I threw org.spark-project.protobuf:protobuf-java:2.4.1-shaded on the Spark class path and the job *seems* to run fine on Spark 1.5.0 when built with Crunch 0.13 On Thu, Nov 5, 2015 at 11:19 AM, Josh Wills wrote: > Spark's dependency tree is an affront to everything good and decent in the > world. I'm going to run the current Crunch master against 1.5.1 locally to > see what all breaks. > > J > -- *DISCLAIMER:* The contents of this email, including any attachments, may contain information that is confidential, proprietary in nature, protected health information (PHI), or otherwise protected by law from disclosure, and is solely for the use of the intended recipient(s). If you are not the intended recipient, you are hereby notified that any use, disclosure or copying of this email, including any attachments, is unauthorized and strictly prohibited. If you have received this email in error, please notify the sender of this email. Please delete this and all copies of this email from your system. Any opinions either expressed or implied in this email and all attachments, are those of its author only, and do not necessarily reflect those of Nuna Health, Inc. --001a11c3aa1cf9de700523d01718 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks Josh!

FWIW I threw org.spa= rk-project.protobuf:protobuf-java:2.4.1-shaded on the Spark class path and = the job seems to run fine on Spark 1.5.0 when built with Crunch 0.13=

On Thu, Nov= 5, 2015 at 11:19 AM, Josh Wills <josh.wills@gmail.com> w= rote:
Spark's depend= ency tree is an affront to everything good and decent in the world. I'm= going to run the current Crunch master against 1.5.1 locally to see what a= ll breaks.

J=C2=A0


DISCLAIMER:=C2=A0The conten= ts of this email, including any attachments, may contain information that i= s confidential, proprietary in nature, protected health information (PHI), = or otherwise protected by law from disclosure, and is solely for the use of= the intended recipient(s). If you are not the intended recipient, you are = hereby notified that any use, disclosure or copying of this email, includin= g any attachments, is unauthorized and strictly prohibited. If you have rec= eived this email in error, please notify the sender of this email. Please d= elete this and all copies of this email from your system. Any opinions eith= er expressed or implied in this email and all attachments, are those of its= author only, and do not necessarily reflect those of Nuna Health, Inc. --001a11c3aa1cf9de700523d01718--