Mailing-List: contact issues-help@flink.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.incubator.apache.org
Date: Tue, 7 Oct 2014 13:18:34 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: issues@flink.incubator.apache.org
Message-ID: <JIRA.12743198.1411394856000.207674.1412687914075@Atlassian.JIRA>
In-Reply-To: <JIRA.12743198.1411394856000@Atlassian.JIRA>
References: <JIRA.12743198.1411394856000@Atlassian.JIRA>
 <JIRA.12743198.1411394856624@arcas>
Subject: [jira] [Commented] (FLINK-1110) Add a serial collection-based
 execution mode
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/FLINK-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161859#comment-14161859 ] 

ASF GitHub Bot commented on FLINK-1110:
---------------------------------------

Github user rmetzger commented on a diff in the pull request:

    https://github.com/apache/incubator-flink/pull/139#discussion_r18518034
  
    --- Diff: flink-examples/flink-java-examples/src/main/java/org/apache/flink/example/java/environments/CollectionExecutionExample.java ---
    @@ -0,0 +1,48 @@
    +/**
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *     http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.flink.example.java.environments;
    +
    +import org.apache.flink.api.common.functions.MapFunction;
    +import org.apache.flink.api.java.CollectionEnvironment;
    +
    +/**
    + * This example shows how to use Flink's collection execution functionality.
    + * Collection-based execution is an extremely lightweight, non-parallel way to
    + * execute programs on small data: The programs are s
    + * 
    + * Because this method of execution spawns no background threads, managed memory, 
    + * coordinator, or parallel worker, it has a minimal execution footprint. 
    + */
    +public class CollectionExecutionExample {
    +
    +	public static void main(String[] args) throws Exception {
    +		
    +		CollectionEnvironment env = new CollectionEnvironment();
    +		
    +		env.fromElements("A", "B", "C", "D")
    +			.map(new MapFunction<String, String>() {
    +				public String map(String value) {
    +					return value + " " + 1;
    +				};
    +			})
    +		.print();
    --- End diff --
    
    Is there a facility to access the results? (a collection from a `DataSet`) ?


> Add a serial collection-based execution mode
> --------------------------------------------
>
>                 Key: FLINK-1110
>                 URL: https://issues.apache.org/jira/browse/FLINK-1110
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>            Priority: Minor
>             Fix For: 0.7-incubating
>
>
> Summary of mailing list thread that the issue is based upon
> Since Flink is a layered system, programs written against the APIs can be executed in a variety of ways. In this case, we just run the functions single-threaded directly on the Java collections, instead of firing up a memory management, IPC, parallel workers, data movement, etc. That gives programs a minimal execution footprint (like in the Java8 streams API) for small data. The idea is to enable users to use the same program in all sorts of different contexts.
> The collection execution should sit below the common API, so both Java and Scala API can use it.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)