spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From colorant <>
Subject [GitHub] spark pull request: [SPARK-2288] Hide ShuffleBlockManager behind S...
Date Fri, 27 Jun 2014 02:19:32 GMT
GitHub user colorant opened a pull request:

    [SPARK-2288] Hide ShuffleBlockManager behind ShuffleManager

    By Hiding the shuffleblockmanager behind Shufflemanager, we decouple the shuffle data's
block mapping management work from Diskblockmananger. This give a more clear interface and
more easy for other shuffle manager to implement their own block management logic. the jira
ticket have more details.

You can merge this pull request into a Git repository by running:

    $ git pull shuffle

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1241
commit 209921361ff80812e95cd640ae66013614fb46b9
Author: Raymond Liu <>
Date:   2014-06-26T07:15:56Z

    Move ShuffleBlockmanager behind shuffleManager

commit 1d606985b9307503d0e61755bdd2ee41a61bc94f
Author: Raymond Liu <>
Date:   2014-06-26T07:42:44Z

    Fix test cases

commit d024134bd501d88ccb450f25cf6fb71478005cae
Author: Raymond Liu <>
Date:   2014-06-26T08:26:09Z

    Fix getBlockLocation

commit 8b885529f639bd0c01dc58f2ca6376cf0ea80a0a
Author: Raymond Liu <>
Date:   2014-06-27T00:51:18Z

    Fix code style


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message