Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CAF14200B36 for ; Wed, 6 Jul 2016 19:54:12 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C4B3B160A73; Wed, 6 Jul 2016 17:54:12 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3FE1F160A64 for ; Wed, 6 Jul 2016 19:54:12 +0200 (CEST) Received: (qmail 52106 invoked by uid 500); 6 Jul 2016 17:54:11 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 52076 invoked by uid 99); 6 Jul 2016 17:54:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jul 2016 17:54:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 26E142C02A6 for ; Wed, 6 Jul 2016 17:54:11 +0000 (UTC) Date: Wed, 6 Jul 2016 17:54:11 +0000 (UTC) From: "Markus Weimer (JIRA)" To: dev@reef.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (REEF-1484) Document IMRU collaboration/data flow MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 06 Jul 2016 17:54:13 -0000 [ https://issues.apache.org/jira/browse/REEF-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364743#comment-15364743 ] Markus Weimer commented on REEF-1484: ------------------------------------- Thanks for bringing this up! This is probably best captured on the website, not the wiki, as it is user documentation.We currently confuse the heck out of people by putting some user docs in the wiki :) > Document IMRU collaboration/data flow > ------------------------------------- > > Key: REEF-1484 > URL: https://issues.apache.org/jira/browse/REEF-1484 > Project: REEF > Issue Type: Bug > Components: Documentation > Reporter: Andrey > > need to document IMRU components interaction. > perhaps small wiki with collaboration and data flow diagrams. > IMRU main flow fairly obvious, but following things required some debugging/reverse engineering: > - input data is not used unless constructor of MapFunction defines it as parameter > - how to configure input data set > - Update function returns iEnumerable of results as generic case. it's up to algorithm to decide which result should be included into the list: it can decide include result from last iteration only > - Map input/output codecs are required in order to serialize/deserialize data across nodes. > - Optional Map input/output data converters can be used by algorithm developer to improve performance of distributed calculations. For instance send subset of dimensions to a node. -- This message was sent by Atlassian JIRA (v6.3.4#6332)