hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tanvir Rahman <tanvir9982...@gmail.com>
Subject Re: Multiple config files after building hadoop src code, Which one to modify?
Date Mon, 13 Feb 2017 23:17:52 GMT
Thanks


On Mon, Feb 13, 2017 at 3:46 PM, Sultan Alamro <sultan.alamro@gmail.com>
wrote:

> After compiling the source code, you can find them here
>
> $HADOOP_HOME/etc/hadoop/
>
> On Feb 13, 2017, at 4:17 PM, Tanvir Rahman <tanvir9982000@gmail.com>
> wrote:
>
> Hello everyone,
> I am currently working on a research project where i need to understand
> the yarn mapreduce Application Master code in hadoop 2.7.3. I have
> downloaded hadoop-2.7.3 source code, built it, I have a local Hadoop
> configuration on my machine and I can successfully run wordcount
> application with that copy.
>
> I am confused about location of exact configuration files. For example, if
> I want to modify the yarn-site.xml file, there are a few hdfs-site.xml in
> my local machine.
>
> tanvir@dhcp143:~> locate yarn-site.xml
> /home/tanvir/backup-hadoop-2.7.3-src-config/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-common-project/hadoop-
> common/target/hadoop-common-2.7.3/etc/hadoop/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.3/etc/hadoop/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-dist/target/hadoop-2.7.
> 3/share/hadoop/tools/sls/sample-conf/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/main/sample-conf/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/src/test/resources/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/
> target/hadoop-sls-2.7.3/sls/sample-conf/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-sls/
> target/test-classes/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-tools/hadoop-tools-
> dist/target/hadoop-tools-dist-2.7.3/share/hadoop/tools/sls/sample-conf/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-yarn/conf/yarn-site.xml~
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-applications/hadoop-yarn-applications-
> distributedshell/src/test/resources/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-applications/hadoop-yarn-applications-
> distributedshell/target/test-classes/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-applications/hadoop-yarn-applications-
> unmanaged-am-launcher/src/test/resources/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-applications/hadoop-yarn-applications-
> unmanaged-am-launcher/target/test-classes/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/hadoop-
> yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/target/test-classes/yarn-site.xml
>
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/
> hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml
> /home/tanvir/hadoop-2.7.3-src/hadoop-yarn-project/target/
> hadoop-yarn-project-2.7.3/etc/hadoop/yarn-site.xml~
>
>
> Currently I am changing all of them (skipping the test cases and
> templates)  and it is working but i wonder which would be the one i should
> modify.
>
>
> Thanks in advance.
> Tanvir
>
>

Mime
View raw message