Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 94526 invoked from network); 12 Dec 2010 17:42:53 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 12 Dec 2010 17:42:53 -0000 Received: (qmail 79049 invoked by uid 500); 12 Dec 2010 17:42:51 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 78918 invoked by uid 500); 12 Dec 2010 17:42:50 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 78910 invoked by uid 99); 12 Dec 2010 17:42:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Dec 2010 17:42:50 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_HELO_PASS X-Spam-Check-By: apache.org Received-SPF: unknown (athena.apache.org: error in processing during lookup of rockowitz@minsoft.com) Received: from [216.86.168.182] (HELO mxout-07.mxes.net) (216.86.168.182) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Dec 2010 17:42:44 +0000 Received: from [192.168.1.81] (unknown [98.207.2.244]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 812DE22E1FB for ; Sun, 12 Dec 2010 12:42:19 -0500 (EST) Message-ID: <4D050975.5050205@minsoft.com> Date: Sun, 12 Dec 2010 09:42:13 -0800 From: Sanford Rockowitz Organization: Minaret Software User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.23) Gecko/20090812 Thunderbird/2.0.0.23 Mnenhy/0.7.6.666 MIME-Version: 1.0 To: common-user@hadoop.apache.org Subject: Re: exceptions copying files into HDFS References: <4D046E9C.5080103@minsoft.com> <4D047A68.6050406@minsoft.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Rahul, I should have been more explicit. I am simply trying to run in pseudo-distributed mode. For further comments, see my previous post to Varadharajan. Thanks, Sanford On 12/12/2010 2:24 AM, rahul patodi wrote: > you can follow this tutorial: > > http://hadoop-tutorial.blogspot.com/2010/11/running-hadoop-in-distributed-mode.html > http://cloudera-tutorial.blogspot.com/2010/11/running-cloudera-in-distributed-mode.html > also, before running any job please ensure all the required processes are > running on the correct node > like on master: > Namenode, jobtracker, secondarynamenode(if you are not running secondary > name node on another system) > > on slave: > datanode, tasktracker > > > On Sun, Dec 12, 2010 at 2:46 PM, Varadharajan Mukundan> wrote: >> HI, >> >>> jps reports DataNode, NameNode, and SecondayNameNode as running: >>> >>> rock@ritter:/tmp/hadoop-rock> jps >>> 31177 Jps >>> 29909 DataNode >>> 29751 NameNode >>> 30052 SecondaryNameNode >> In master node, the output of the "JPS" will contain a tasktracker, >> jobtracker, namenode, secondary namenode, datanode(optional, depending on >> your config) and your slaves will have tasktracker, datanodes in their jps >> output. If you need more help on configuring hadoop, i recommend you to >> take >> a look at >> >> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ >> >> >> >> >>> Here is the contents of the Hadoop node tree. The only thing that looks >>> like a log file are the dncp_block_verification.log.curr files, and those >>> are empty. >>> Note the presence of the in_use.lock files, which suggests that this node >> is >>> indeed being used. >> >> The logs will be in the "logs" directory in $HADOOP_HOME (hadoop home >> directory), are you looking for logs in this directory? >> >> >> -- >> Thanks, >> M. Varadharajan >> >> ------------------------------------------------ >> >> "Experience is what you get when you didn't get what you wanted" >> -By Prof. Randy Pausch in "The Last Lecture" >> >> My Journal :- www.thinkasgeek.wordpress.com >> > >