hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tanvir Rahman <tanvir9982...@gmail.com>
Subject Multiple config files after building hadoop src code, Which one to modify?
Date Mon, 13 Feb 2017 21:17:39 GMT
Hello everyone,
I am currently working on a research project where i need to understand the
yarn mapreduce Application Master code in hadoop 2.7.3. I have downloaded
hadoop-2.7.3 source code, built it, I have a local Hadoop configuration on
my machine and I can successfully run wordcount application with that copy.

I am confused about location of exact configuration files. For example, if
I want to modify the yarn-site.xml file, there are a few hdfs-site.xml in
my local machine.

tanvir@dhcp143:~> locate yarn-site.xml
/home/tanvir/backup-hadoop-2.7.3-src-config/yarn-site.xml
/home/tanvir/hadoop-2.7.3-src/hadoop-common-project/hadoop-common/target/hadoop-common-2.7.3/etc/hadoop/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.3/etc/hadoop/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.3/share/hadoop/tools/sls/sample-conf/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/main/sample-conf/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/test/resources/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/target/hadoop-sls-2.7.3/sls/sample-conf/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/target/test-classes/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-tools-dist/target/hadoop-tools-dist-2.7.3/share/hadoop/tools/sls/sample-conf/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml~

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/resources/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/test-classes/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/src/test/resources/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-unmanaged-am-launcher/target/test-classes/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml

/home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml~



Currently I am changing all of them (skipping the test cases and templates)
 and it is working but i wonder which would be the one i should modify.


Thanks in advance.
Tanvir

Mime
View raw message