Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E98511157F for ; Mon, 28 Jul 2014 12:58:49 +0000 (UTC) Received: (qmail 81692 invoked by uid 500); 28 Jul 2014 12:58:44 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 81589 invoked by uid 500); 28 Jul 2014 12:58:44 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 81579 invoked by uid 99); 28 Jul 2014 12:58:44 -0000 Received: from Unknown (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Jul 2014 12:58:44 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [79.99.40.130] (HELO auth-smtp-01.streamline.net) (79.99.40.130) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Jul 2014 12:58:27 +0000 Received: by auth-smtp-01.streamline.net (Postfix, from userid 500) id E666616BBB65; Mon, 28 Jul 2014 13:58:01 +0100 (BST) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on auth-smtp-01.streamline.net Received: from [192.168.0.4] (unknown [176.27.4.123]) (Authenticated sender: studio@chrismackenziephotography.co.uk) by auth-smtp-01.streamline.net (Postfix) with ESMTP id 82D3916C0786 for ; Mon, 28 Jul 2014 13:57:55 +0100 (BST) User-Agent: Microsoft-MacOutlook/14.4.3.140616 Date: Mon, 28 Jul 2014 13:58:00 +0100 Subject: Re: How to set up the conf folder From: Chris MacKenzie To: Message-ID: Thread-Topic: How to set up the conf folder References: In-Reply-To: Mime-version: 1.0 Content-type: text/plain; charset="EUC-KR" Content-transfer-encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi Ravindra, Thanks for replying, it=A1=AFs much appreciated. That=A1=AFs always been the case with my setup: export HADOOP_PREFIX=3D"/scratch/extra/cm469/hadoop-2.4.1" export HADOOP_CONF_DIR=3D$HADOOP_PREFIX/etc/hadoop I think my issue is that I have not set yarn-env.sh up correctly. TBH I didn=A1=AFt know it existed. I plan to get round to trying that at some point in the near future. Many thanks, Chris MacKenzie telephone: 0131 332 6967 email: studio@chrismackenziephotography.co.uk corporate: www.chrismackenziephotography.co.uk From: Ravindra Reply-To: Date: Monday, 28 July 2014 13:09 To: Subject: Re: How to set up the conf folder Hi, Could you try putting this in .bash_profile export HADOOP_CONF_DIR=3D/scratch/extra/cm469/hadoop-2.4.1/etc/hadoop/ Regards, Ravindra On Wed, Jul 23, 2014 at 3:17 PM, Chris MacKenzie wrote: Hi, Can anyone shed some light on this for me. Every time I attempt to set up the conf directory, I run into a whole load of errors and ssh issues which I don=A9=F6t see when my config files are in etc/hadoop I want to understand how to use the conf directory. My ultimate goal is to use symbolic links I have a running cluster based version of hadoop-2.4.1. I start and stop the cluster from the RM with: ./hadoop-2.4.1/sbin/start-dfs.sh ./hadoop-2.4.1/sbin/start-yarn.sh My understanding is that to use the conf directory my settings should be was follows: Settings: bash-profile has $HADOOP_CONF_DIR =3D /scratch/extra/cm469/hadoop-2.4.1/etc/hadoop Hadoop-env.sh has export HADOOP_CONF_DIR=3D${HADOOP_CONF_DIR:-"/etc/hadoop/conf=A9=F7} conf/core-site.xml conf/hdfs-site.xml conf/mapred-site.xml conf/yarn-site.xml conf/capacity-scheduler.xml etc/hadoop/hadoop-env.sh etc/hadoop/slaves etc/hadoop/masters Thanks in advance, Chris MacKenzie telephone: 0131 332 6967 email: studio@chrismackenziephotography.co.uk corporate: www.chrismackenziephotography.co.uk