hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sultan Alamro <sultan.ala...@gmail.com>
Subject Re: Multiple config files after building hadoop src code, Which one to modify?
Date Mon, 13 Feb 2017 21:46:32 GMT
After compiling the source code, you can find them here

$HADOOP_HOME/etc/hadoop/

> On Feb 13, 2017, at 4:17 PM, Tanvir Rahman <tanvir9982000@gmail.com> wrote:
> 
> Hello everyone,
> I am currently working on a research project where i need to understand the yarn mapreduce
Application Master code in hadoop 2.7.3. I have downloaded hadoop-2.7.3 source code, built
it, I have a local Hadoop configuration on my machine and I can successfully run wordcount
application with that copy.
> 
> I am confused about location of exact configuration files. For example, if I want to
modify the yarn-site.xml file, there are a few hdfs-site.xml in my local machine.
> 
> tanvir@dhcp143:~> locate yarn-site.xml 
> /home/tanvir/backup-hadoop-2.7.3-src-config/yarn-site.xml 
> /home/tanvir/hadoop-2.7.3-src/hadoop-common-project/hadoop-common/target/hadoop-common-2.7.3/etc/hadoop/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.3/etc/hadoop/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.3/share/hadoop/tools/sls/sample-conf/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/main/sample-conf/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/test/resources/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/target/hadoop-sls-2.7.3/sls/sample-conf/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/target/test-classes/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-tools-dist/target/hadoop-tools-dist-2.7.3/share/hadoop/tools/sls/sample-conf/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml 
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml~ 
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/resources/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/test-classes/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/resources/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/target/test-classes/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml

> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml~

> 
> 
> Currently I am changing all of them (skipping the test cases and templates)  and it is
working but i wonder which would be the one i should modify.
> 
> 
> Thanks in advance.
> Tanvir
> 

Mime
View raw message