Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 43772 invoked from network); 11 Sep 2009 07:10:16 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Sep 2009 07:10:16 -0000 Received: (qmail 64409 invoked by uid 500); 11 Sep 2009 07:10:14 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 64331 invoked by uid 500); 11 Sep 2009 07:10:14 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 64321 invoked by uid 500); 11 Sep 2009 07:10:14 -0000 Delivered-To: apmail-hadoop-core-user@hadoop.apache.org Received: (qmail 64318 invoked by uid 99); 11 Sep 2009 07:10:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Sep 2009 07:10:14 +0000 X-ASF-Spam-Status: No, hits=3.4 required=10.0 tests=HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [202.165.105.135] (HELO web15205.mail.cnb.yahoo.com) (202.165.105.135) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 11 Sep 2009 07:10:03 +0000 Received: (qmail 64973 invoked by uid 60001); 11 Sep 2009 07:09:41 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.cn; s=s1024; t=1252652981; bh=ykpnfjV/2R0qMJEw5qNZBz5JA07F9anXHONDHLzFLhA=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=ObrxY+O2gq2aYqlBfb4Q6wgUU/gS+p28fNACZosSBK4BRBRdggOmhHkWt9F7/nv17HBhTjpFjbLk1wczvVoJCISWAKu/urbjAHkGDkHvl2VV/kOh0xBHWM84i8Q5F6c5cOSuB8Qcs0hm2dduC2Pe0iORWlIHpJ/5qpbmtAOJTLg= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com.cn; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=X27pQ9piYcOxdXU/eDb96AWtzOOJBEUiqSlsMXGthmVYqkoolvCPXVQM15dI0J5QEg7aAwiMCLKkFqMIMdTNG1aNdMorPEBAKgXxCW4pOXRNgWWLIhNQFghdMUEtj3sicDW27r86FDQzCvQVprDLxWLP0xHV5vIfVUMsVEpJFG4=; Message-ID: <344889.64919.qm@web15205.mail.cnb.yahoo.com> X-YMail-OSG: gNxicNIVM1k6PkALx3uwzlFnsWvZ2aLTAnEI7cgJAfWxSY8AM0Q3FgHk5YhHxfJ4eC0rou2y7dgM3e2atJKFFm2PL0NMqsnjHGeC6AlNiSm6yrvah3XUhbBHUWsWhpwRD8U.867X3BCUKxz79RVl2P.ftB5SWwKnonkxDM4ist8FGsxkcP7GlffIPgyDtg9iB9MvZILrU3MVQQ-- Received: from [125.34.40.134] by web15205.mail.cnb.yahoo.com via HTTP; Fri, 11 Sep 2009 00:09:40 PDT X-Mailer: YahooMailClassic/7.0.14 YahooMailWebService/0.7.338.2 Date: Fri, 11 Sep 2009 00:09:40 -0700 (PDT) From: qiu tian Subject: =?utf-8?B?6L2s5Y+ROiBhIHByb2JsZW0gaW4gaGFkb29wIGNsdXN0ZXI6cmVkdWNlIHRh?= =?utf-8?B?c2sgY291bGRuJ3QgZmluZCBtYXAgdGFza3MnIG91dHB1dC4=?= To: core-user@hadoop.apache.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-296730255-1252652980=:64919" X-Virus-Checked: Checked by ClamAV on apache.org --0-296730255-1252652980=:64919 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable --- 09=E5=B9=B49=E6=9C=8811=E6=97=A5=EF=BC=8C=E5=91=A8=E4=BA=94, qiu tian <= tianqiu_527@yahoo.com.cn> =E5=86=99=E9=81=93=EF=BC=9A =E5=8F=91=E4=BB=B6=E4=BA=BA: qiu tian =E4=B8=BB=E9=A2=98: a problem in hadoop cluster:reduce task couldn't find m= ap tasks' output. =E6=94=B6=E4=BB=B6=E4=BA=BA: common-user@hadoop.apache.org, common-user-hel= p@hadoop.apache.org =E6=97=A5=E6=9C=9F: 2009=E5=B9=B49=E6=9C=8811=E6=97=A5,=E5=91=A8=E4=BA=94,= =E4=B8=8B=E5=8D=881:57 Hi everyone! I tried hadoop cluster setup on 4 pcs. I ran into a=0Aproblem about hadoop-= common. when I ran the command'bin/hadoop jar=0Ahadoop-*-examples.jar wordc= ount input output', the map tasks could=0Acomplet quickly, but the reduce p= hase took very long to complet. I=0Athink it's caused by the config, so I c= hanged the hadoop-site.xml for=0Amany times, which didn't work. Here are ha= doop-site.xml: =0A namevaluedescriptionfs.default.namehdfs://192.*.*.*:9000 mapred.job.tracker=0A192.*.*.*:9001 hadoop.tmp.dir/home/*/hadoop/tmp =0A =0A =0A =0A here is another hadoop-site.xml: namevaluedescriptionfs.default.namehdfs://192.*.*.*:9000 mapred.job.tracker=0A192.*.*.*:9001 hadoop.tmp.dir/home/*/hadoop/tmp dfs.replication2 =0Adfs.name.dir/home/*/hadoop/file/name dfs.data.dir/home/*/hadoop/file/data mapred.system.dir=0A/home/*/hadoop/file/mapred/ system mapred.local.dir/home/*/hadoop/file/mapred/ local mapred.temp.dir=0A/home/*/hadoop/file/mapred/tmp mapred.tasktracker.map.tasks. maximum2 mapred.tasktracker.reduce. tasks.maximum=0A2 Both of them above couldn't work. Here is a problem from a tasktracker: 2009-09-10 20:08:35,169 INFO org.apache.hadoop.mapred. TaskTracker: org.apa= che.hadoop.util. DiskChecker$ DiskErrorException: Could not find taskTracke= r/jobcache/job_ 200909102001_0001/attempt_ 200909102001_0001_m_000005_0/ ou= tput/file.out in any of the configured local directories =0A I=C2=A0 am looking forward to your reply! Thanks! Yan =0A=0A=0A =E5=A5=BD=E7=8E=A9=E8=B4=BA=E5=8D=A1=E7=AD=89=E4=BD=A0=E5= =8F=91=EF=BC=8C=E9=82=AE=E7=AE=B1=E8=B4=BA=E5=8D=A1=E5=85=A8=E6=96=B0=E4=B8= =8A=E7=BA=BF=EF=BC=81=0A=0A=0A _______________________________________= ____________________ =0A =E5=A5=BD=E7=8E=A9=E8=B4=BA=E5=8D=A1=E7=AD=89=E4= =BD=A0=E5=8F=91=EF=BC=8C=E9=82=AE=E7=AE=B1=E8=B4=BA=E5=8D=A1=E5=85=A8=E6=96= =B0=E4=B8=8A=E7=BA=BF=EF=BC=81 =0Ahttp://card.mail.cn.yahoo.com/ --0-296730255-1252652980=:64919--