Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Tue, 26 May 2015 07:42:18 +0000 (UTC)
From: "Till Rohrmann (JIRA)" <jira@apache.org>
To: dev@flink.apache.org
Message-ID: <JIRA.12832652.1432626108000.24908.1432626138698@Atlassian.JIRA>
In-Reply-To: <JIRA.12832652.1432626108000@Atlassian.JIRA>
References: <JIRA.12832652.1432626108000@Atlassian.JIRA>
 <JIRA.12832652.1432626108700@arcas>
Subject: [jira] [Created] (FLINK-2090) toString of CollectionInputFormat
 takes long time when the collection is huge
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Till Rohrmann created FLINK-2090:
------------------------------------

             Summary: toString of CollectionInputFormat takes long time when the collection is huge
                 Key: FLINK-2090
                 URL: https://issues.apache.org/jira/browse/FLINK-2090
             Project: Flink
          Issue Type: Improvement
            Reporter: Till Rohrmann
            Priority: Minor


The {{toString}} method of {{CollectionInputFormat}} calls {{toString}} on its underlying {{Collection}}. Thus, {{toString}} is called for each element of the collection. If the {{Collection}} contains many elements or the individual {{toString}} calls for each element take a long time, then the string generation can take a considerable amount of time. [~mikiobraun] noticed that when he inserted several jBLAS matrices into Flink.

The {{toString}} method is mainly used for logging statements in {{DataSourceNode}}'s {{computeOperatorSpecificDefaultEstimates}} method and in {{JobGraphGenerator.getDescriptionForUserCode}}. I'm wondering whether it is necessary to print the complete content of the underlying {{Collection}} or if it's not enough to print only the first 3 elements in the {{toString}} method.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)