ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Ozerov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-3414) Hadoop: Optimize map-reduce job planning.
Date Wed, 06 Jul 2016 19:06:11 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15364912#comment-15364912
] 

Vladimir Ozerov commented on IGNITE-3414:
-----------------------------------------

Yes, I meant LinkedHashSet here.

> Hadoop: Optimize map-reduce job planning.
> -----------------------------------------
>
>                 Key: IGNITE-3414
>                 URL: https://issues.apache.org/jira/browse/IGNITE-3414
>             Project: Ignite
>          Issue Type: Task
>          Components: hadoop
>    Affects Versions: 1.6
>            Reporter: Vladimir Ozerov
>            Assignee: Vladimir Ozerov
>            Priority: Critical
>             Fix For: 1.7
>
>
> Currently Hadoop module has inefficient map-reduce planning engine. In particular, it
assigns tasks only to affinity nodes. It could lead to situation when very huge tasks is processed
by a single cluster node, while other cluster nodes are idle. 
> We should implement configurable map-reduce planner which will be able to utilize the
whole cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message