hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@yahoo-inc.com>
Subject Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Date Fri, 16 Oct 2009 17:56:40 GMT


On Oct 16, 2009, at 9:56 AM, Arun C Murthy wrote:

> On Oct 16, 2009, at 9:20 AM, Vitaliy Avdeev wrote:
>> Yes I meant final.
>> But why when I am using  Configuration.writeXML(out) there is no   
>> <final>
>> parameters in saved file?
> This was a conscious decision we made in HADOOP-785.
> The idea is that a Configuration is serialized from the 'client  
> context'. The client configuration is always loaded on 'top' of the  
> configuration stack at runtime on the server (either at the  
> JobTracker on job-submission or at the TaskTracker during task- 
> execution) and thus the notion of 'final' parameters is moot.
> Having said that you do have a valid cause for complaint; I've  
> recently been involved in some discussions with the Pig team where  
> we concluded that this feature could be useful during task  
> localization on the TaskTracker i.e. the TaskTracker should set the  
> 'localized' parameters of the task to be 'final'. The short end of  
> the stick is I'd request you to open a jira asking for this  
> enhancement... please?
> thanks,
> Arun

View raw message