hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2668) MR-279: APPLICATION_STOP is never sent to AuxServices
Date Mon, 03 Oct 2011 16:37:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119391#comment-13119391

Vinod Kumar Vavilapalli commented on MAPREDUCE-2668:

Logically, services are inited per application and need to be given a signal on app-finish.

bq. The application then either needs to know what all services the containers used on that
particular nm or we broadcast the stop message to the services and they stop as necessary.
I've chosen to do the second route.
Today many things for the aux-services are done by convention. For e.g, map tasks leave the
outputs in some directories and ShuffleHandler picks them up by convention. Ideally we will
need map-tasks to register their outputs with the service, but that is far into the future,
if ever.

+1 for your second route of broadcasting app-stop message(AuxServicesEventType.APPLICATION_STOP)
to all services.

> MR-279: APPLICATION_STOP is never sent to AuxServices
> -----------------------------------------------------
>                 Key: MAPREDUCE-2668
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2668
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Robert Joseph Evans
>            Assignee: Thomas Graves
>            Priority: Blocker
>             Fix For: 0.23.0
> APPLICATION_STOP is never sent to the AuxServices only APPLICATION_INIT.  This means
that all map intermediate data will never be deleted.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message