Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 40B3918C69 for ; Fri, 21 Aug 2015 18:12:10 +0000 (UTC) Received: (qmail 88932 invoked by uid 500); 21 Aug 2015 18:12:08 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 88842 invoked by uid 500); 21 Aug 2015 18:12:08 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 88831 invoked by uid 99); 21 Aug 2015 18:12:08 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Aug 2015 18:12:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id B4CFAC0721 for ; Fri, 21 Aug 2015 18:12:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 5.5 X-Spam-Level: ***** X-Spam-Status: No, score=5.5 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, KAM_PATRIOT2=2.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id aO8ynzs97ceD for ; Fri, 21 Aug 2015 18:11:55 +0000 (UTC) Received: from relayvx11a.securemail.intermedia.net (relayvx11a.securemail.intermedia.net [64.78.56.46]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 317AE20F6D for ; Fri, 21 Aug 2015 18:11:55 +0000 (UTC) Received: from securemail.intermedia.net (localhost [127.0.0.1]) by emg-ca-1-1.localdomain (Postfix) with ESMTP id 97EDE53E36; Fri, 21 Aug 2015 11:11:54 -0700 (PDT) Subject: Re: Tungsten and sun.misc.Unsafe MIME-Version: 1.0 x-echoworx-msg-id: df0d63b7-e2ae-4fd9-b7be-516494014eae x-echoworx-emg-received: Fri, 21 Aug 2015 11:11:54.609 -0700 x-echoworx-action: delivered Received: from emg-ca-1-1.securemail.intermedia.net ([10.254.155.11]) by emg-ca-1-1 (JAMES SMTP Server 2.3.2) with SMTP ID 184; Fri, 21 Aug 2015 11:11:54 -0700 (PDT) Received: from MBX080-W4-CO-1.exch080.serverpod.net (unknown [10.224.117.101]) by emg-ca-1-1.localdomain (Postfix) with ESMTP id 5872953E95; Fri, 21 Aug 2015 11:11:54 -0700 (PDT) Received: from MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) by MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Fri, 21 Aug 2015 11:11:53 -0700 Received: from MBX080-W4-CO-2.exch080.serverpod.net ([10.224.117.102]) by mbx080-w4-co-2.exch080.serverpod.net ([10.224.117.102]) with mapi id 15.00.1044.021; Fri, 21 Aug 2015 11:11:53 -0700 From: Steve Loughran To: Marek Kolodziej CC: dev Thread-Topic: Tungsten and sun.misc.Unsafe Thread-Index: AQHQ3A0Kb2K/xDaO3kGshKAR+63Y2Z4XN3+A Date: Fri, 21 Aug 2015 18:11:52 +0000 Message-ID: <2A58B310-9F56-4DAA-8AA8-8C0CCD871089@hortonworks.com> References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [24.20.224.144] x-source-routing-agent: Processed Content-Type: multipart/alternative; boundary="_000_2A58B3109F564DAA8AA88C0CCD871089hortonworkscom_" --_000_2A58B3109F564DAA8AA88C0CCD871089hortonworkscom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable On 21 Aug 2015, at 05:29, Marek Kolodziej > wrote: I doubt that Oracle would want to make life difficult for everyone. In addi= tion to Spark's code base, projects such as Akka, Cassandra, Hibernate, Net= ty, Neo4j and Spring (among many others) depend on Unsafe. Still, there are= tons of posts about this issue in the Java community (e.g. here's a Hazelcast interv= iew, also from Aug. 3, the day before the latest update to JEP 260). There = are tons of concerned posts on the blogosphere, too (e.g. here). Have the leaders of the Spark community been following these Unsafe-related= developments and if so, what's Spark's plan of handling whatever Oracle th= rows our way? I don't know about Spark, but I know that Hadoop uses a lot of it, introspe= cting into sun.security for access to kerberos operations, switching to the= ibm. equivalent. Without that kerberos simply doesn't work. As of now, the project's stance is "if Oracle want hadoop to run on Oracle = Java 9, they'd better have a plan" --_000_2A58B3109F564DAA8AA88C0CCD871089hortonworkscom_ Content-Type: text/html; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable
On 21 Aug 2015, at 05:29, Marek Kolodziej <mkolod.dev@gmail.com> wrote:
I doubt that Oracle would want to make life difficult for everyone. In addi= tion to Spark's code base, projects such as Akka, Cassandra, Hibernate, Net= ty, Neo4j and Spring (among many others) depend on Unsafe. Still, there are= tons of posts about this issue in the Java community (e.g. here's a Hazelcast interv= iew, also from Aug. 3, the day before the latest update to JEP 260). There = are tons of concerned posts on the blogosphere, too (e.g. here).

Have the leaders of the Spark community been following these Unsafe-related= developments and if so, what's Spark's plan of handling whatever Oracle th= rows our way?

I don't know about Spark, but I know that Hadoop uses a lot= of it, introspecting into sun.security for access to kerberos operations, = switching to the ibm. equivalent. Without that kerberos simply doesn't work= .

As of now, the project's stance is "if Oracle want had= oop to run on Oracle Java 9, they'd better have a plan"
--_000_2A58B3109F564DAA8AA88C0CCD871089hortonworkscom_--