Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D8FD9B62 for ; Mon, 9 Jan 2012 18:14:34 +0000 (UTC) Received: (qmail 28499 invoked by uid 500); 9 Jan 2012 18:14:30 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 28240 invoked by uid 500); 9 Jan 2012 18:14:29 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 28227 invoked by uid 99); 9 Jan 2012 18:14:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jan 2012 18:14:28 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of iefinkel@gmail.com designates 209.85.210.176 as permitted sender) Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jan 2012 18:14:20 +0000 Received: by iapp10 with SMTP id p10so9175258iap.35 for ; Mon, 09 Jan 2012 10:13:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type; bh=e9yU1IcxieHF+Z109zdBA0oHdYeowocHPCExfhpyUK0=; b=xX/3y6bDGcgUW2nYILdlZkG1R82vWGbdFvTFRlkNHpJ1O66LFa4j0ECqbp5BfoiG91 7dsDczWjXwv9TeYHCl+lk7+lmjPLTj83Nroo6nBVt7Ig9MNMr+vacAdwHkh3AO4jL4gp NgO80ItuKm5vfCP7GJjtUBPrFB1Zqp1awGDjo= Received: by 10.42.29.6 with SMTP id p6mr18196421icc.44.1326132839241; Mon, 09 Jan 2012 10:13:59 -0800 (PST) Received: from Eli-Finkelshteyns-MacBook-Pro.local ([38.112.1.90]) by mx.google.com with ESMTPS id q30sm37580822ibc.1.2012.01.09.10.13.58 (version=SSLv3 cipher=OTHER); Mon, 09 Jan 2012 10:13:58 -0800 (PST) Message-ID: <4F0B2E6E.8080204@gmail.com> Date: Mon, 09 Jan 2012 13:14:06 -0500 From: Eli Finkelshteyn User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:8.0) Gecko/20111105 Thunderbird/8.0 MIME-Version: 1.0 To: common-user@hadoop.apache.org Subject: Netstat Shows Port 8020 Doesn't Seem to Listen Content-Type: multipart/alternative; boundary="------------080708080504040007090808" X-Virus-Checked: Checked by ClamAV on apache.org --------------080708080504040007090808 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hi, I've been googling, but haven't been able to find an answer. I'm currently trying to setup Hadoop in pseudo-distributed mode as a first step. I'm using the Cloudera distro and installed everything through YUM on CentOS 5.7. I can run everything just fine from my one node itself (hadoop fs -ls /, test map-red jobs, etc...), but can't get a remote client to be able to connect to it. I'm pretty sure the cause of that has to do with the fact that port 8020 and port 8021 do not seem to be listening (when I do a netstat -a, they don't show up-- all the other Hadoop related ports like 50030 and 50070 do show up). I verified that the firewall allows connections over 8020 and 8021 for tcp, and can connect through my web browser to 50030 and 50070. Looking at the namenode log, I see the following error which looks suspicious and related to me: 2012-01-09 12:03:38,000 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8020: starting 2012-01-09 12:03:38,009 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 8020: starting 2012-01-09 12:03:39,187 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 8020: starting 2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 8020: starting 2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8020: starting 2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020: starting 2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 8020: starting 2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020: starting 2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 8020: starting 2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020: starting 2012-01-09 12:03:39,246 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 8020: starting 2012-01-09 12:03:39,258 WARN org.apache.hadoop.util.PluginDispatcher: Unable to load dfs.namenode.plugins plugins 2012-01-09 12:03:40,254 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020, call addBlock(/var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info, DFSClient_-1779116177, null) from 127.0.0.1:39785: error: java.io.IOException: File /var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 1 Anyone have any idea what my problem might be? Cheers, Eli --------------080708080504040007090808--