hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: Externalizing Hadoop configuration files
Date Thu, 17 Feb 2011 00:11:23 GMT

See also https://issues.apache.org/jira/browse/HADOOP-5670 .


On Feb 16, 2011, at 3:32 PM, Ted Yu wrote:

> You need to develop externalization yourself.
> 
> Our installer uses place holders such as:
> <property>
>  <name>fs.checkpoint.dir</name>
> 
> <value>dataFolderPlaceHolder/dfs/namesecondary,backupFolderPlaceHolder/namesecondary</value>
> 
> They would be resolved at time of deployment.
> 
> On Wed, Feb 16, 2011 at 3:06 PM, Jing Zang <purpleheart36@hotmail.com>wrote:
> 
>> 
>> How do I externalize the parameters in hadoop configuration files so make
>> it easier for the operations team?. Ideally something like:
>> File: mapred-site.xml
>> <property>        <name>mapred.job.tracker</name>
>> <value>${hadoop.mapred}</value>    </property>
>> File: hadoop.conf (External to the app)hadoop.mapred=hadoop:9001
>> Anything as easy as Spring' sPropertyPlaceholderConfigurer or similar? How
>> do you guys externalize the parameters to a configuration file outside the
>> app?
>> Thanks.


Mime
View raw message