ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Ozerov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-3414) Hadoop: Optimize map-reduce job planning.
Date Mon, 04 Jul 2016 06:48:11 GMT
Vladimir Ozerov created IGNITE-3414:
---------------------------------------

             Summary: Hadoop: Optimize map-reduce job planning.
                 Key: IGNITE-3414
                 URL: https://issues.apache.org/jira/browse/IGNITE-3414
             Project: Ignite
          Issue Type: Task
          Components: hadoop
    Affects Versions: 1.6
            Reporter: Vladimir Ozerov
            Assignee: Vladimir Ozerov
            Priority: Critical
             Fix For: 1.7


Currently Hadoop module has inefficient map-reduce planning engine. In particular, it assigns
tasks only to affinity nodes. It could lead to situation when very huge tasks is processed
by a single cluster node, while other cluster nodes are idle. 

We should implement configurable map-reduce planner which will be able to utilize the whole
cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message