Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1874510CBB for ; Tue, 8 Sep 2015 09:03:49 +0000 (UTC) Received: (qmail 36496 invoked by uid 500); 8 Sep 2015 09:03:46 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 36446 invoked by uid 500); 8 Sep 2015 09:03:45 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 36436 invoked by uid 99); 8 Sep 2015 09:03:45 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Sep 2015 09:03:45 +0000 Date: Tue, 8 Sep 2015 09:03:45 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-2631) StreamFold operator does not respect returns type and stores non serializable values MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FLINK-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734462#comment-14734462 ] ASF GitHub Bot commented on FLINK-2631: --------------------------------------- Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1101#issuecomment-138487240 Does the `OutputTypeConfigurable` also work for `TwoInputOperator`? > StreamFold operator does not respect returns type and stores non serializable values > ------------------------------------------------------------------------------------ > > Key: FLINK-2631 > URL: https://issues.apache.org/jira/browse/FLINK-2631 > Project: Flink > Issue Type: Bug > Reporter: Till Rohrmann > Assignee: Till Rohrmann > > The {{StreamFold}} operator stores the initial value of the fold operation for the task deployment. This value does not necessarily have to be serializable. Thus, using the fold operation with a non-serializable initial value will fail the job. > Moreover, the {{StreamFold}} operator needs to know the output type in order to create a {{TypeSerializer}}. For {{StreamGraphs}} where the output type is not know when the operator is created, as it is the case for the Scala DataStream API which directly sets the output type after creating the operator via the {{returns}} method, this approach will fail. The reason is that the {{StreamFold}} operator does receive the type information set by the {{returns}} method. Therefore, the job will fail at runtime because the operator tries to create a serializer from a {{MissingTypeInformation}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332)