ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-4507) Hadoop: allow direct shuffle mode when combiner is set
Date Tue, 17 Jan 2017 11:46:26 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825919#comment-15825919

ASF GitHub Bot commented on IGNITE-4507:

GitHub user tledkov-gridgain opened a pull request:


    IGNITE-4507  Hadoop: allow direct shuffle mode when combiner is set


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gridgain/apache-ignite ignite-4507

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1434
commit c893da70a9757b16b0799adc8eaa29fa1b03d06e
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-21T11:54:33Z

    IGNITE-4399: IGFS: Merged IgfsSecondaryFileSystem and IgfsSecondaryFileSystemV2 interfaces.
This closes #1346.

commit c5882a85f4e3a1f61723ac54fd92f087684df6da
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-26T11:15:42Z

    Merge branch 'master' into ignite-2.0

commit 7e73d0223a3f09cbe0b7094a2c04bdf9d63ca9be
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-28T09:54:47Z

    Merge branch 'master' into ignite-2.0

commit 7d82d6a06b5e9f1f8cd2909b865e37d46b8da03f
Author: devozerov <vozerov@gridgain.com>
Date:   2016-12-28T09:58:11Z

    IGNITE-3875: Introduced separate thread pool for data streamer. This closes #1173. This
closes #1383.

commit a61b0eaff1817d84c0659e8a7e095f29e22800e1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-28T11:09:38Z

    IGNITE-4405: Hadoop: implemented "readLine" method for HadoopDataInStream and HadoopDirectDataInput
classes. This closes #1358.

commit 2df39a80d80e2575be61a902ccd48615796fcde9
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-28T13:47:24Z

    IGNITE-3961: IGFS: Added IgfsSecondaryFileSystem.affintiy() method. This closes #1114.
This closes #1252.

commit 2e691d80ea4870c3e7b5b127792b66c920f72c39
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:00:01Z

    IGNITE-4462: IGFS: removed grid name from HadoopIgfsEndpoint. This closes #1368.

commit a9b1fc2b3840d47d7c978d9296e8ae6bdeb10be5
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:07:22Z

    IGNITE-4459: Hadoop: weighted planned is default one from now on. This closes #1391.

commit 1f743465d6875ef48b1835d03a78a0dbaf339bf6
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2016-12-29T08:14:10Z

    IGNITE-4458: Hadoop: "striped" shuffle mode is default from now on. This closes #1390.

commit 6090ebdfcd0ea3840b0d32cb10197b43615e1e89
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-05T09:23:06Z

    Merge branch 'master' into ignite-2.0

commit 19638eb74f8fc8924b730bd015b670540d230809
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-12T11:19:47Z

    IGNITE-4507: add debug print

commit 9907509bbe72831700310f98b7f4546048794d59
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T09:31:55Z

    add test add debug print

commit 77ca2e636c73e464f833f227c4894df0785ae9e2
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-16T13:07:49Z

    Merge branch 'master' into ignite-2.0

commit d14e0727b3dd61ab5ec2957133d77dbc25e9ba68
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T13:36:25Z

    IGNITE-4428: Hadoop: moved HadoopMapReducePlanner and dependent classes to public space.
This closes #1389. This closes #1394.

commit f1365421c299b754a10edf8b6f156aeeb5ff0ce1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-16T13:57:27Z

    IGNITE-4503: Hadoop: added boundary checks to HadoopDirectDataInput. This closes # 1416.

commit 0f9a8eb0d886ebe62e5c2c08b2f80aeb251badc1
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:09:02Z

    use direct shuffle with combiner

commit b34519a51cf3abfc59361351f64e49421d950685
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:10:44Z

    remove debug print

commit b14823f0a0bdfcc3fe44a0a0d2057189a72ba506
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T09:10:52Z

    Merge branch 'ignite-2.0' into ignite-4507

commit d4a427b00869276bafbd8d49af9a9f729d3c0408
Author: tledkov-gridgain <tledkov@gridgain.com>
Date:   2017-01-17T11:44:36Z

    setup mapper index for combiner


> Hadoop: allow direct shuffle mode when combiner is set
> ------------------------------------------------------
>                 Key: IGNITE-4507
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4507
>             Project: Ignite
>          Issue Type: Task
>          Components: hadoop
>    Affects Versions: 1.8
>            Reporter: Vladimir Ozerov
>            Assignee: Taras Ledkov
>             Fix For: 2.0
> Currently "direct" shuffle mode is not used when combiner is set. It is necessary to
investigate root cause of this limitation and remove it if possible.

This message was sent by Atlassian JIRA

View raw message