ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-4516) Hadoop: add optional gzip compression for shuffle output
Date Wed, 04 Jan 2017 14:51:58 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15798440#comment-15798440

ASF GitHub Bot commented on IGNITE-4516:

GitHub user devozerov opened a pull request:




You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gridgain/apache-ignite ignite-4516

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1399
commit 795a97584db46898b92c2a93b434ab9c48615563
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-04T13:33:19Z

    Added GZIP property.

commit 654e7e45ad962a440ca37b9dd5d8f72b0d7a3852
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-04T13:51:17Z

    Implemented write part.

commit 9cbd9abaf3e9d7d9f7df0a9751749d34eb16dbb7
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-04T13:59:57Z

    Implemented read part.

commit 35344e5ec0e882cc3bf2d06c5a3b4967323a8fa4
Author: devozerov <vozerov@gridgain.com>
Date:   2017-01-04T14:30:53Z

    Added TeraSort test.


> Hadoop: add optional gzip compression for shuffle output
> --------------------------------------------------------
>                 Key: IGNITE-4516
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4516
>             Project: Ignite
>          Issue Type: Task
>          Components: hadoop
>            Reporter: Vladimir Ozerov
>            Assignee: Vladimir Ozerov
>             Fix For: 2.0
> It was already implemented, but then reverted back due to performance drop. However,
this feature might still be very useful because it decrease amount of heap memory required
to store intermediate output for remote nodes. 
> See commit 0062362.

This message was sent by Atlassian JIRA

View raw message