Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DAC8E119AE for ; Fri, 20 Jun 2014 06:35:49 +0000 (UTC) Received: (qmail 60013 invoked by uid 500); 20 Jun 2014 06:35:49 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 59956 invoked by uid 500); 20 Jun 2014 06:35:49 -0000 Mailing-List: contact dev-help@flink.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.incubator.apache.org Delivered-To: mailing list dev@flink.incubator.apache.org Received: (qmail 59945 invoked by uid 99); 20 Jun 2014 06:35:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jun 2014 06:35:49 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 20 Jun 2014 06:35:50 +0000 Received: (qmail 55559 invoked by uid 99); 20 Jun 2014 06:35:25 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jun 2014 06:35:25 +0000 Date: Fri, 20 Jun 2014 06:35:25 +0000 (UTC) From: "Robert Metzger (JIRA)" To: dev@flink.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (FLINK-958) Sorting a group when key is a Writable gives a NonSerializable Error MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/FLINK-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-958: --------------------------------- Component/s: Hadoop Compatibility > Sorting a group when key is a Writable gives a NonSerializable Error > -------------------------------------------------------------------- > > Key: FLINK-958 > URL: https://issues.apache.org/jira/browse/FLINK-958 > Project: Flink > Issue Type: Bug > Components: Hadoop Compatibility, Java API > Reporter: Artem Tsikiridis > > I cannot sort an unsorted group by key when the key Is a Writable. Is it a bug? > Consider: > {code} > Grouping> res = myData > .map(new MapFunction, Tuple2>() { > @Override > public Tuple2 map( > Tuple2 value) throws Exception { > return new Tuple2(new Text(value.f0), new LongWritable(value.f1)); > } > }) > .groupBy(0).sortGroup(0, Order.ASCENDING); > {code} > This gives the following stacktrace: > {code} > Caused by: java.io.NotSerializableException: sun.misc.Launcher$AppClassLoader > at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) > at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) > at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) > at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) > at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) > at java.io.ObjectOutputStream.writeArray(ObjectOutputStream.java:1377) > at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1173) > at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) > at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) > at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) > at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) > at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) > at eu.stratosphere.util.InstantiationUtil.serializeObject(InstantiationUtil.java:250) > at eu.stratosphere.util.InstantiationUtil.writeObjectToConfig(InstantiationUtil.java:231) > at eu.stratosphere.api.java.typeutils.runtime.RuntimeComparatorFactory.writeParametersToConfig(RuntimeComparatorFactory.java:40) > ... 14 more > {code} > Is it not supported to sort groupings with writables as keys? I understand this is a hadoop serialization error, but so far I am not able to fix it. > Any ideas? -- This message was sent by Atlassian JIRA (v6.2#6252)