Return-Path: X-Original-To: apmail-ignite-issues-archive@minotaur.apache.org Delivered-To: apmail-ignite-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5005F18F25 for ; Fri, 15 Jan 2016 08:32:40 +0000 (UTC) Received: (qmail 35993 invoked by uid 500); 15 Jan 2016 08:32:40 -0000 Delivered-To: apmail-ignite-issues-archive@ignite.apache.org Received: (qmail 35961 invoked by uid 500); 15 Jan 2016 08:32:40 -0000 Mailing-List: contact issues-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list issues@ignite.apache.org Received: (qmail 35853 invoked by uid 99); 15 Jan 2016 08:32:39 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jan 2016 08:32:39 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CB26B2C1F58 for ; Fri, 15 Jan 2016 08:32:39 +0000 (UTC) Date: Fri, 15 Jan 2016 08:32:39 +0000 (UTC) From: "Denis Magda (JIRA)" To: issues@ignite.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (IGNITE-2391) IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/IGNITE-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101469#comment-15101469 ] Denis Magda commented on IGNITE-2391: ------------------------------------- Lets start reproducing the issue in the following way: - Prepare Hadoop server nodes with big amount of data in it. - Let's compare Ignite MR vs Hortonswork MR without IGFS. - If Ignite MR works better or the same as Hortonswork MR then start debugging why IGFS slow downs the test. Probably there is an issue in the affinity. > IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR > ---------------------------------------------------------- > > Key: IGNITE-2391 > URL: https://issues.apache.org/jira/browse/IGNITE-2391 > Project: Ignite > Issue Type: Bug > Components: IGFS > Affects Versions: 1.5 > Reporter: Denis Magda > Priority: Blocker > Fix For: 1.6 > > > A performance test of IGFS MR vs Traditional HDFS (Hortonswork) MR and performance here was actually worse using IGFS MR. > 5 ignite nodes on the 5 data nodes were setup, each also with 64GB ram. > The same sample search via Hunk was done, making sure Hunk initiated the MR stage. The only change in both runs was only to run IGFS MR or Traditional MR over HDFS > > Traditional MR over HDFS. > This search has completed in 54.701seconds. > IGFS MR > This search has completed in 75.959seconds. -- This message was sent by Atlassian JIRA (v6.3.4#6332)