ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denis Magda (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-2391) IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR
Date Fri, 15 Jan 2016 08:32:39 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101469#comment-15101469
] 

Denis Magda commented on IGNITE-2391:
-------------------------------------

Lets start reproducing the issue in the following way:
- Prepare Hadoop server nodes with big amount of data in it.
- Let's compare Ignite MR vs Hortonswork MR without IGFS.
- If Ignite MR works better or the same as Hortonswork MR then start debugging why IGFS slow
downs the test. Probably there is an issue in the affinity.

> IGFS + Ignite MR works slower than Hadoop (Hortonswork) MR
> ----------------------------------------------------------
>
>                 Key: IGNITE-2391
>                 URL: https://issues.apache.org/jira/browse/IGNITE-2391
>             Project: Ignite
>          Issue Type: Bug
>          Components: IGFS
>    Affects Versions: 1.5
>            Reporter: Denis Magda
>            Priority: Blocker
>             Fix For: 1.6
>
>
> A performance test of IGFS MR vs Traditional HDFS (Hortonswork) MR and performance here
was actually worse using IGFS MR.
> 5 ignite nodes on the 5 data nodes were setup, each also with 64GB ram.
> The same sample search via Hunk was done, making sure Hunk initiated the MR stage. The
only change in both runs was only to run IGFS MR or Traditional MR over HDFS
>  
> Traditional MR over HDFS.
> This search has completed in 54.701seconds.
> IGFS MR
> This search has completed in 75.959seconds.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message