Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 086B0200D1A for ; Mon, 9 Oct 2017 19:56:29 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 06C591609E0; Mon, 9 Oct 2017 17:56:29 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4D0351609B8 for ; Mon, 9 Oct 2017 19:56:28 +0200 (CEST) Received: (qmail 42068 invoked by uid 500); 9 Oct 2017 17:56:27 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 42055 invoked by uid 99); 9 Oct 2017 17:56:27 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Oct 2017 17:56:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 51E1ED7E16 for ; Mon, 9 Oct 2017 17:56:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.349 X-Spam-Level: X-Spam-Status: No, score=0.349 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id jw8PUq_kl3wO for ; Mon, 9 Oct 2017 17:56:25 +0000 (UTC) Received: from mail-pf0-f179.google.com (mail-pf0-f179.google.com [209.85.192.179]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 830DC60E4C for ; Mon, 9 Oct 2017 17:56:24 +0000 (UTC) Received: by mail-pf0-f179.google.com with SMTP id b79so2218570pfk.5 for ; Mon, 09 Oct 2017 10:56:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=tIDwNf3iUpdpgzTNvjYvB8GjQM8tZvE0lgAf58cqh+E=; b=qzZDu5QxtlNxSw8lcx8yzQL1jFwzJIXZUckZLPfgJMuuN7Qdzl4TwEz9fadyTyZdn4 FtA1rgQjJ3+T9EP6QGBNIXR8YmZgKFdBtddqW2cyX9LkuCaFck8I3dhpTziJrviQp+uf P2vcGWW/Hg0gZHeZiVef8YQ7yWNCRUUnxUpI0MQOYHLVh/f7Bk5uXQr/lpY4qY1oMDXb pD8lfKNmliEQCKTYtfatZCVnIO+egUOEeOXDyndLLL933lAZL8AyeBo4CPpr371Eb22b kI9MLY8uUWGrCxQCA/rlrncRDpIlF7ZIWnslNOHyINncrhPqHWnzfIguiwuKF/AS3mrF Gbgw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=tIDwNf3iUpdpgzTNvjYvB8GjQM8tZvE0lgAf58cqh+E=; b=P9LM3gpNl3yL0rM1pZgCeOqTL7CQ5DlOAXhG2NguGR9bRG4D5RRJShkXt06ICYgo2i PqvamqMoHcYwPzNbD7b8M7YQG44NZv9ZZiQ+4kw1sU6j60Wehit8sLA075T18Wujim94 oeV/WG0DxuxyrG5RtHxhGIv6R+HWUnoNjPXHZGgmYCPaEod3AuJE5semljYpwQ/XJhtw 4T8ArTQgkGcniKLo2GXPphEv9RD4CcIE5aJdsAYJDAUHSLyKkWYMV+kfkcIOzCnh/bFH 03ETZCapsDGy/M5FX4JUjqwoIKKCfu95Gy2gH7+dL4ym7dXCwd2rrluOp6+dM4ITVmr2 LDPw== X-Gm-Message-State: AMCzsaXiFS3H2DDzegmmSSVhaoxrc3cQf05zkk2OI2iX/BMv22sRQQI2 3bMlSpWEnwmqeLBOyy2b+dAXpCd0yKNbP5/5RNo= X-Google-Smtp-Source: AOwi7QBrIooBBffGUe0EU+zetY5AYIaTNv1wb4Sch41z0+gmksqRWnWLpVPuJse+Hf4X5UuMclXbIDey//6IIR9GSv0= X-Received: by 10.98.70.6 with SMTP id t6mr8793643pfa.257.1507571782529; Mon, 09 Oct 2017 10:56:22 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.151.129 with HTTP; Mon, 9 Oct 2017 10:56:22 -0700 (PDT) In-Reply-To: References: From: Saikat Kanjilal Date: Mon, 9 Oct 2017 10:56:22 -0700 Message-ID: Subject: Re: reef-runtime-spark and java8 To: dev@reef.apache.org Content-Type: multipart/alternative; boundary="94eb2c0b8e96923699055b20e8eb" archived-at: Mon, 09 Oct 2017 17:56:29 -0000 --94eb2c0b8e96923699055b20e8eb Content-Type: text/plain; charset="UTF-8" Thanks Byon-Gon, I will implement a workaround that simulates a lambda function in spark, however it'd be really great to move to Java1.8 sooner than later as a lot of the spark versions have functional programming constructs embedded inside them which are easier to implement in Java1.8. Let me know if we as a community should push on this, would be glad to help. On Sun, Oct 8, 2017 at 10:35 PM, Byung-Gon Chun wrote: > Hi Saikat, > > Thanks for initiating the discussion. > > My lab has been using Java8 to build systems on top of REEF. I'm favoring > for moving to Java8, but this depends on the Java requirements of > downstream clients. > > Thanks. > -Gon > > --- > Byung-Gon Chun > > On Mon, Oct 9, 2017 at 12:20 PM, Saikat Kanjilal > wrote: > > > Hi Reef Development Community, > > As part of implementing reef-runtime-spark based on a dataloader > strategy I > > am trying to embed a lambda function inside a map operation over a spark > > rdd , from reading the documentation it seems like lambda expressions are > > only supported on Java8, however when I look at the top level pom file > for > > reef I see that the reef codebase is compiled using Java7. I can try to > > figure out a workaround for this but was wondering if there's a plan for > > moving to Java8 in the near term? > > > > Thoughts. > > > > > > -- > Byung-Gon Chun > --94eb2c0b8e96923699055b20e8eb--