Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Date: Mon, 3 Oct 2011 16:37:34 +0000 (UTC)
From: "Vinod Kumar Vavilapalli (Commented) (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: 
 <1272438094.3490.1317659854353.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <945999194.3575.1310407859853.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (MAPREDUCE-2668) MR-279: APPLICATION_STOP is
 never sent to AuxServices
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119391#comment-13119391 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2668:
----------------------------------------------------

Logically, services are inited per application and need to be given a signal on app-finish.

bq. The application then either needs to know what all services the containers used on that particular nm or we broadcast the stop message to the services and they stop as necessary. I've chosen to do the second route.
Today many things for the aux-services are done by convention. For e.g, map tasks leave the outputs in some directories and ShuffleHandler picks them up by convention. Ideally we will need map-tasks to register their outputs with the service, but that is far into the future, if ever.

+1 for your second route of broadcasting app-stop message(AuxServicesEventType.APPLICATION_STOP) to all services.

                
> MR-279: APPLICATION_STOP is never sent to AuxServices
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-2668
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2668
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Robert Joseph Evans
>            Assignee: Thomas Graves
>            Priority: Blocker
>             Fix For: 0.23.0
>
>
> APPLICATION_STOP is never sent to the AuxServices only APPLICATION_INIT.  This means that all map intermediate data will never be deleted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira