From common-dev-return-79168-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org Mon Jul 9 20:27:30 2012 Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 96A54D3C6 for ; Mon, 9 Jul 2012 20:27:30 +0000 (UTC) Received: (qmail 85510 invoked by uid 500); 9 Jul 2012 20:27:28 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 85450 invoked by uid 500); 9 Jul 2012 20:27:28 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 85440 invoked by uid 99); 9 Jul 2012 20:27:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jul 2012 20:27:28 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of pavan.baburao@gmail.com designates 209.85.213.48 as permitted sender) Received: from [209.85.213.48] (HELO mail-yw0-f48.google.com) (209.85.213.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jul 2012 20:27:22 +0000 Received: by yhfq46 with SMTP id q46so11301160yhf.35 for ; Mon, 09 Jul 2012 13:27:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HaYeO86De34YsvJL/yEhyicJ+668hgntC3PhDtwPlM0=; b=F7KdEBZlHNvkLIK154ujEfD+kw/riJzvGap//PI3+yUJwiIVZq+r33x9TVt0LD7hRN oqp2Bb5k2wHOMngFBPQC+0F8CGZx05ks90JRyBIRRVEhQCFM2wEoB/5zjYgvYJllTpxv cy0K0d25HNWtITm3PAG1gUYKbyzSqIR8cm8AKQ3JGfsdr+JgVoCGWDP9Qu4BWQu23+Ry jAugoOPYJh0GuSOcGztKkq27+2j16kPsotMlJo+Zbtp9y3kL7Ho/L2E9zvxxCuqD1RoD Z3nfFQrE6mEqbY2QBT7+FwsRFka6TJAm77qNFB03CxFuomceGGptx8+GC/4mDmUE2nwE hCrQ== MIME-Version: 1.0 Received: by 10.50.181.232 with SMTP id dz8mr9559194igc.72.1341865621517; Mon, 09 Jul 2012 13:27:01 -0700 (PDT) Received: by 10.50.42.226 with HTTP; Mon, 9 Jul 2012 13:27:01 -0700 (PDT) In-Reply-To: References: Date: Mon, 9 Jul 2012 13:27:01 -0700 Message-ID: Subject: Re: No mapred-site.xml in the hadoop-0.23.3 distribution From: Pavan Kulkarni To: common-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=14dae934064bb4f66304c46b6f02 --14dae934064bb4f66304c46b6f02 Content-Type: text/plain; charset=ISO-8859-1 Thanks a lot Robert. I also assume we need to set JAVA_HOME parameter in the hadoop-env.sh . I couldn't find this file as default just like mapred-site.xml.Am I correct? On Mon, Jul 9, 2012 at 12:36 PM, Robert Evans wrote: > On 2.0 core-site, yarn-site, hdfs-site, and mapped-site are all kind of > needed. The exact configs that you need to set may very a lot based off > of what you are trying to do. > --Bobby Evans > > On 7/6/12 6:58 PM, "Pavan Kulkarni" wrote: > > >Hi Robert, > > > > Can you please share what all configuration files are mandatory for the > >hadoop-0.23.3 to work. > >I am tuning a few but still not able to set it up completely.Thanks > > > >On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans > wrote: > > > >> Sorry I don't know of a good source for that right now. Perhaps others > >>on > >> the list might know better then I do. > >> > >> On 7/6/12 12:05 PM, "Pavan Kulkarni" wrote: > >> > >> >Bobby, > >> > > >> > Thanks a lot for your clarification. > >> >Yes as you said it is just a template, but it may > >> >be quite confusing to new users while configuring. > >> >I have raised the Issue > >> >, > >> >in case you might want to > >> >have a look.Thanks > >> > > >> > Also I wanted to know is there a good source where I can > >> >look upto for running a multi-node 2nd generation Hadoop ? > >> >All I find is 1st generation Hadoop setup. > >> > > >> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans > >>wrote: > >> > > >> >> That may be something that we missed, as I have been providing my own > >> >> marped-site.xml for quite a while now. Have you tried it with > >>branch-2 > >> >>or > >> >> trunk to see if they are providing it? In either case it is just > >>going > >> >>to > >> >> be a template for you to fill in, but it would be nice to package > >>that > >> >> template for our users to follow. If you want to file a JIRA for > >>that > >> >>it > >> >> would be good, but I don't know how quickly we will be able to get > >> >>around > >> >> to doing it. > >> >> > >> >> --Bobby Evans > >> >> > >> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" wrote: > >> >> > >> >> >Hi, > >> >> > > >> >> > I downloaded the Hadoop-0.23.3 source and tweaked a few classes > >>and > >> >> >when I built the binary distribution and untar'd it .I don't see the > >> >> >mapred-site.xml > >> >> >file in the /etc/hadoop directory. But by the details given on how > >>to > >> >>run > >> >> >the > >> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right? > >> >> > > >> >> > So I was just wondering if we are supposed to create the > >> >>mapred-site.xml > >> >> >, or > >> >> >it doesn't exist at all? Thanks > >> >> > > >> >> >-- > >> >> > > >> >> >--With Regards > >> >> >Pavan Kulkarni > >> >> > >> >> > >> > > >> > > >> >-- > >> > > >> >--With Regards > >> >Pavan Kulkarni > >> > >> > > > > > >-- > > > >--With Regards > >Pavan Kulkarni > > -- --With Regards Pavan Kulkarni --14dae934064bb4f66304c46b6f02--