Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 582A5200C17 for ; Fri, 10 Feb 2017 20:02:01 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 56890160B5C; Fri, 10 Feb 2017 19:02:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 98A21160B4E for ; Fri, 10 Feb 2017 20:02:00 +0100 (CET) Received: (qmail 23445 invoked by uid 500); 10 Feb 2017 19:01:54 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 23435 invoked by uid 99); 10 Feb 2017 19:01:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Feb 2017 19:01:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5EAAFC135A for ; Fri, 10 Feb 2017 19:01:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.173 X-Spam-Level: ** X-Spam-Status: No, score=2.173 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, NML_ADSP_CUSTOM_MED=1.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id APd6vzqaD8KR for ; Fri, 10 Feb 2017 19:01:53 +0000 (UTC) Received: from mbob.nabble.com (mbob.nabble.com [162.253.133.15]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id A376F5F647 for ; Fri, 10 Feb 2017 19:01:53 +0000 (UTC) Received: from static.162.255.23.37.macminivault.com (unknown [162.255.23.37]) by mbob.nabble.com (Postfix) with ESMTP id CC6113C70820 for ; Fri, 10 Feb 2017 10:41:09 -0800 (PST) Date: Fri, 10 Feb 2017 12:01:23 -0700 (MST) From: dpolacza To: user@ignite.apache.org Message-ID: <1486753283026-10551.post@n6.nabble.com> Subject: ignite as Hadoop's Map Reduce engine - how it works? MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Fri, 10 Feb 2017 19:02:01 -0000 Hi, Can someone describe how MapReduce is implemented when hadoop's job is processed? How does shuffling work? How is Reduce node chosen? Is it possible to speedup job scheduling by changing standard settings? I saw in Debug log that some transactions are initiated is it possible to turn it off? Regards -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ignite-as-Hadoop-s-Map-Reduce-engine-how-it-works-tp10551.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.