Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 183E7200CEF for ; Mon, 4 Sep 2017 20:52:28 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1694716538B; Mon, 4 Sep 2017 18:52:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5D217165389 for ; Mon, 4 Sep 2017 20:52:27 +0200 (CEST) Received: (qmail 29868 invoked by uid 500); 4 Sep 2017 18:52:21 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 29858 invoked by uid 99); 4 Sep 2017 18:52:21 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Sep 2017 18:52:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 1C511182534 for ; Mon, 4 Sep 2017 18:52:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.172 X-Spam-Level: ** X-Spam-Status: No, score=2.172 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, NML_ADSP_CUSTOM_MED=1.2, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.972] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id HDSxFuPL151B for ; Mon, 4 Sep 2017 18:52:16 +0000 (UTC) Received: from n6.nabble.com (n6.nabble.com [162.255.23.37]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id B877360E11 for ; Mon, 4 Sep 2017 18:52:15 +0000 (UTC) Received: from n6.nabble.com (localhost [127.0.0.1]) by n6.nabble.com (Postfix) with ESMTP id 522BE184ED09 for ; Mon, 4 Sep 2017 11:52:14 -0700 (MST) Date: Mon, 4 Sep 2017 11:52:14 -0700 (MST) From: ihorps To: user@ignite.apache.org Message-ID: <1504551134290-0.post@n6.nabble.com> In-Reply-To: <1504288123395-0.post@n6.nabble.com> References: <1504099965772-0.post@n6.nabble.com> <1504106488070-0.post@n6.nabble.com> <1504126950777-0.post@n6.nabble.com> <1504194865361-0.post@n6.nabble.com> <1504288123395-0.post@n6.nabble.com> Subject: Re: Task management - MapReduce & ForkJoin performance penalty MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Mon, 04 Sep 2017 18:52:28 -0000 hi @ezhuravlev Thank you for your reply, very appreciated! I can confirm that by adding real business logic to Jobs it's actually scales horizontally quite well and by adding more nodes the whole task finishes just faster. One more think, which I'm looking now on is running tasks with help of MapReduce API in collocated fashion. As far as I understood from documentation ( Collocate Computing and Data ) this is possible only by calling affinityCall(...) or affinityRun(...), which take IgniteCallable or IgniteRunnable. I'd like to create a ComputeTask (ComputeTaskAdapter or ComputeTaskSplitAdapter), which would spawn ComputeJob with affinity key (let's say in constructor) and execute them on node with co-located data. So is this possible to do such somehow? I couldn't find for now how it can be done in elegant way... Thank you in advance. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/