hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Augusto Souza (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6444) Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS
Date Wed, 05 Aug 2015 22:54:05 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Augusto Souza updated MAPREDUCE-6444:
-------------------------------------
    Description: 
Patch to add classes to provide a checkpointable version of shuffle and reduce context. Also,
add a classe which makes possible to save a checkpoint of a task in HDFS. Those classes are
respectively: CheckpointableShuffle, CheckpointableReduceContextImpl and TaskCheckpointManager.

This improvement also helps in the splitting of patch in MAPREDUCE-5269 that is too large
for being reviewed or accepted by Jenkins CI scripts.

  was:
Patch to add classes to provide a checkpointable version of shuffle and reduce context. Also,
add a classe which makes possible to save a checkpoint of a task in HDFS. Those classes are
respectively: CheckpointableShuffle, CheckpointableReduceContextImpl and TaskCheckpointManager.

This issue also helps in the splitting of patch in MAPREDUCE-5269 that is too large for being
reviewed or accepted by Jenkins CI scripts.


> Add a checkpointable version of shuffle and reduce context supported by a checkpoint
manager which uses the HDFS
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6444
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6444
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Augusto Souza
>            Assignee: Augusto Souza
>
> Patch to add classes to provide a checkpointable version of shuffle and reduce context.
Also, add a classe which makes possible to save a checkpoint of a task in HDFS. Those classes
are respectively: CheckpointableShuffle, CheckpointableReduceContextImpl and TaskCheckpointManager.
> This improvement also helps in the splitting of patch in MAPREDUCE-5269 that is too large
for being reviewed or accepted by Jenkins CI scripts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message