ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-4507) Hadoop: allow direct shuffle mode when combiner is set
Date Tue, 17 Jan 2017 11:46:26 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825919#comment-15825919
] 

ASF GitHub Bot commented on IGNITE-4507:
----------------------------------------

GitHub user tledkov-gridgain opened a pull request:

    https://github.com/apache/ignite/pull/1434

    IGNITE-4507  Hadoop: allow direct shuffle mode when combiner is set

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gridgain/apache-ignite ignite-4507

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/ignite/pull/1434.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1434
    
----
commit c893da70a9757b16b0799adc8eaa29fa1b03d06e
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-21T11:54:33Z

    IGNITE-4399: IGFS: Merged IgfsSecondaryFileSystem and IgfsSecondaryFileSystemV2 interfaces.
This closes #1346.

commit c5882a85f4e3a1f61723ac54fd92f087684df6da
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-26T11:15:42Z

    Merge branch 'master' into ignite-2.0

commit 7e73d0223a3f09cbe0b7094a2c04bdf9d63ca9be
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-28T09:54:47Z

    Merge branch 'master' into ignite-2.0

commit 7d82d6a06b5e9f1f8cd2909b865e37d46b8da03f
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-28T09:58:11Z

    IGNITE-3875: Introduced separate thread pool for data streamer. This closes #1173. This
closes #1383.

commit a61b0eaff1817d84c0659e8a7e095f29e22800e1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-28T11:09:38Z

    IGNITE-4405: Hadoop: implemented "readLine" method for HadoopDataInStream and HadoopDirectDataInput
classes. This closes #1358.

commit 2df39a80d80e2575be61a902ccd48615796fcde9
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-28T13:47:24Z

    IGNITE-3961: IGFS: Added IgfsSecondaryFileSystem.affintiy() method. This closes #1114.
This closes #1252.

commit 2e691d80ea4870c3e7b5b127792b66c920f72c39
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:00:01Z

    IGNITE-4462: IGFS: removed grid name from HadoopIgfsEndpoint. This closes #1368.

commit a9b1fc2b3840d47d7c978d9296e8ae6bdeb10be5
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:07:22Z

    IGNITE-4459: Hadoop: weighted planned is default one from now on. This closes #1391.

commit 1f743465d6875ef48b1835d03a78a0dbaf339bf6
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:14:10Z

    IGNITE-4458: Hadoop: "striped" shuffle mode is default from now on. This closes #1390.

commit 6090ebdfcd0ea3840b0d32cb10197b43615e1e89
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-05T09:23:06Z

    Merge branch 'master' into ignite-2.0

commit 19638eb74f8fc8924b730bd015b670540d230809
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-12T11:19:47Z

    IGNITE-4507: add debug print

commit 9907509bbe72831700310f98b7f4546048794d59
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T09:31:55Z

    add test add debug print

commit 77ca2e636c73e464f833f227c4894df0785ae9e2
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-16T13:07:49Z

    Merge branch 'master' into ignite-2.0

commit d14e0727b3dd61ab5ec2957133d77dbc25e9ba68
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T13:36:25Z

    IGNITE-4428: Hadoop: moved HadoopMapReducePlanner and dependent classes to public space.
This closes #1389. This closes #1394.

commit f1365421c299b754a10edf8b6f156aeeb5ff0ce1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T13:57:27Z

    IGNITE-4503: Hadoop: added boundary checks to HadoopDirectDataInput. This closes # 1416.

commit 0f9a8eb0d886ebe62e5c2c08b2f80aeb251badc1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:09:02Z

    use direct shuffle with combiner

commit b34519a51cf3abfc59361351f64e49421d950685
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:10:44Z

    remove debug print

commit b14823f0a0bdfcc3fe44a0a0d2057189a72ba506
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:10:52Z

    Merge branch 'ignite-2.0' into ignite-4507

commit d4a427b00869276bafbd8d49af9a9f729d3c0408
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T11:44:36Z

    setup mapper index for combiner

----


> Hadoop: allow direct shuffle mode when combiner is set
> ------------------------------------------------------
>
>                 Key: IGNITE-4507
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4507
>             Project: Ignite
>          Issue Type: Task
>          Components: hadoop
>    Affects Versions: 1.8
>            Reporter: Vladimir Ozerov
>            Assignee: Taras Ledkov
>             Fix For: 2.0
>
>
> Currently "direct" shuffle mode is not used when combiner is set. It is necessary to
investigate root cause of this limitation and remove it if possible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message