Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AC8AFE757 for ; Wed, 6 Feb 2013 01:38:29 +0000 (UTC) Received: (qmail 86555 invoked by uid 500); 6 Feb 2013 01:38:24 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 86471 invoked by uid 500); 6 Feb 2013 01:38:24 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 86464 invoked by uid 99); 6 Feb 2013 01:38:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 01:38:24 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of zhangjun.julian@gmail.com designates 209.85.210.181 as permitted sender) Received: from [209.85.210.181] (HELO mail-ia0-f181.google.com) (209.85.210.181) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 01:38:19 +0000 Received: by mail-ia0-f181.google.com with SMTP id k25so919745iah.26 for ; Tue, 05 Feb 2013 17:37:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=Mit9Vx1uF72DiVhTxNNYI6rZd7iLPJmvRpHCWmOdx+4=; b=AKw+WRLR3wTIkpSoCiWQlarQKy7onlWSSJ49vMB8qWHcdYMUSEjepzePiX+Ocbm0o+ kNods0rDuYbSvYKxadlx9nnJcfqMkZOrq5K8GYucyy6hTTfO9hPIWnsfLzYbHRW5A5bO OYRQn07/2YuTkfScmHR5iZCLYh4WQSu1DDUQ08O7SSNhc3OOTPgUdeNx+2NPUtbP4XQd dfQdjQp8Rml44C9BTDqMN7TOGMjLY+60nJ3/A36/pJ3dgUg1YkYu73OOEO+/crbRMkEx I/oLy11r98eUCDKRytTDhCycxyabIsFnPdG7vKgCgS09HxbvY34Dk9jYFwWiPY1ENluA UO3Q== MIME-Version: 1.0 X-Received: by 10.50.151.176 with SMTP id ur16mr2441847igb.30.1360114678961; Tue, 05 Feb 2013 17:37:58 -0800 (PST) Received: by 10.50.43.136 with HTTP; Tue, 5 Feb 2013 17:37:58 -0800 (PST) In-Reply-To: References: Date: Wed, 6 Feb 2013 09:37:58 +0800 Message-ID: Subject: Re: Use vaidya but error in parsing conf file From: jun zhang To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f3b9f3b4b165504d5046026 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f3b9f3b4b165504d5046026 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable You can find it with google "vaidya github hadoop" link is https://github.com/facebook/hadoop-20/tree/master/src/contrib/vaidy= a But these is only 5 rules will be checked. It was not as useful as I wished. And my problem is fixed by change file://home to file:/home 2013/2/5 Dhanasekaran Anbalagan > Hi jun, > > I am very much interested with vaidya project. to analysis the mapreduce > job, output. I read some weblinks, We have already using CDH4, where you > can get from source vaidya. Please guide me How to test my MR jon to vaid= ya. > > -Dhanasekaran > > Did I learn something today? If not, I wasted it. > > > On Mon, Feb 4, 2013 at 2:15 AM, jun zhang wrot= e: > >> I=92m try to use vaidya to check my mr job, but always get the error >> info like the below >> >> what's the home here? Need I setting any things >> >> ./vaidya_new.sh -jobconf >> file://home/jt1_1359122958375_job_201301252209_1384_conf.xml -joblog >> file://home/job_201301252209_1384_1359959201318_b -testconf >> /opt/hadoop/contrib/vaidya/conf/postex_diagnosis_tests.xml -report >> ./report.xml >> >> 13/02/04 15:06:04 FATAL conf.Configuration: error parsing conf file: >> java.net.UnknownHostException: home >> Exception:java.lang.RuntimeException: java.net.UnknownHostException: >> homejava.lang.RuntimeException: java.net.UnknownHostException: home >> at >> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:139= 5) >> at >> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:12= 69) >> at >> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1200) >> at >> org.apache.hadoop.conf.Configuration.get(Configuration.java:501) >> at >> org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:131) >> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:242) >> at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:225) >> at >> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.read= JobInformation(PostExPerformanceDiagnoser.java:138) >> at >> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.(PostExPerformanceDiagnoser.java:112) >> at >> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main= (PostExPerformanceDiagnoser.java:220) >> Caused by: java.net.UnknownHostException: home >> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:177) >> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) >> at java.net.Socket.connect(Socket.java:529) >> at java.net.Socket.connect(Socket.java:478) >> at sun.net.NetworkClient.doConnect(NetworkClient.java:163) >> at sun.net.NetworkClient.openServer(NetworkClient.java:118) >> at sun.net.ftp.FtpClient.openServer(FtpClient.java:488) >> at sun.net.ftp.FtpClient.openServer(FtpClient.java:475) >> at >> sun.net.www.protocol.ftp.FtpURLConnection.connect(FtpURLConnection.java:= 270) >> at >> sun.net.www.protocol.ftp.FtpURLConnection.getInputStream(FtpURLConnectio= n.java:352) >> at >> com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEnt= ity(XMLEntityManager.java:653) >> at >> com.sun.org.apache.xerces.internal.impl.XMLVersionDetector.determineDocV= ersion(XMLVersionDetector.java:186) >> at >> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML1= 1Configuration.java:772) >> at >> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML1= 1Configuration.java:737) >> at >> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.jav= a:119) >> at >> com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.jav= a:235) >> at >> com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(Docume= ntBuilderImpl.java:284) >> at >> javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:180) >> at >> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:130= 0) >> ... 9 more >> > > --e89a8f3b9f3b4b165504d5046026 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable You can find it with google "vaidya github hadoop"

=

But these is only 5 rules will be checked.=A0

It was not =A0 as useful as I wished.

<= div>And my problem is fixed by change file://home to file:/home
<= div>


2013/2/5 Dhanasekaran Anb= alagan <bugcy013@gmail.com>
Hi jun,

<= /div>I am very much interested with vaidya project= . to analysis the mapreduce job, output. I read some weblinks, We ha= ve already using CDH4, where you can get from source vaidya. Please guide m= e How to test my MR jon to vaidya.

-Dhanasekaran

Did I learn something today? If no= t, I wasted it.


On Mon, Feb 4, 2013 at 2:15 AM, jun zhan= g <zhangjun.julian@gmail.com> wrote:
I=92m try to use vaidya to check my mr job, but always get the error
info like the below

what's the home here? Need I setting any things

=A0./vaidya_new.sh -jobconf
file://home/jt1_1359122958375_job_201301252209_1384_conf.xml -joblog
file://home/job_201301252209_1384_1359959201318_b =A0-testconf
/opt/hadoop/contrib/vaidya/conf/postex_diagnosis_tests.xml -report
./report.xml

13/02/04 15:06:04 FATAL conf.Configuration: error parsing conf file:
java.net.UnknownHostException: home
Exception:java.lang.RuntimeException: java.net.UnknownHostException:
homejava.lang.RuntimeException: java.net.UnknownHostException: home
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.loadResource(Config= uration.java:1395)
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.loadResources(Confi= guration.java:1269)
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.getProps(Configurat= ion.java:1200)
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.get(Configuration.j= ava:501)
=A0 =A0 =A0 =A0 at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem= .java:131)
=A0 =A0 =A0 =A0 at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:242)=
=A0 =A0 =A0 =A0 at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java= :225)
=A0 =A0 =A0 =A0 at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerforman= ceDiagnoser.readJobInformation(PostExPerformanceDiagnoser.java:138)
=A0 =A0 =A0 =A0 at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerforman= ceDiagnoser.<init>(PostExPerformanceDiagnoser.java:112)
=A0 =A0 =A0 =A0 at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerforman= ceDiagnoser.main(PostExPerformanceDiagnoser.java:220)
Caused by: java.net.UnknownHostException: home
=A0 =A0 =A0 =A0 at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:17= 7)
=A0 =A0 =A0 =A0 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:36= 6)
=A0 =A0 =A0 =A0 at java.net.Socket.connect(Socket.java:529)
=A0 =A0 =A0 =A0 at java.net.Socket.connect(Socket.java:478)
=A0 =A0 =A0 =A0 at sun.net.NetworkClient.doConnect(NetworkClient.java:163)<= br> =A0 =A0 =A0 =A0 at sun.net.NetworkClient.openServer(NetworkClient.java:118)=
=A0 =A0 =A0 =A0 at sun.net.ftp.FtpClient.openServer(FtpClient.java:488)
=A0 =A0 =A0 =A0 at sun.net.ftp.FtpClient.openServer(FtpClient.java:475)
=A0 =A0 =A0 =A0 at sun.net.www.protocol.ftp.FtpURLConnection.connect(FtpURL= Connection.java:270)
=A0 =A0 =A0 =A0 at sun.net.www.protocol.ftp.FtpURLConnection.getInputStream= (FtpURLConnection.java:352)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.impl.XMLEntityManager= .setupCurrentEntity(XMLEntityManager.java:653)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.impl.XMLVersionDetect= or.determineDocVersion(XMLVersionDetector.java:186)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.parsers.XML11Configur= ation.parse(XML11Configuration.java:772)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.parsers.XML11Configur= ation.parse(XML11Configuration.java:737)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.parsers.XMLParser.par= se(XMLParser.java:119)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.parsers.DOMParser.par= se(DOMParser.java:235)
=A0 =A0 =A0 =A0 at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderI= mpl.parse(DocumentBuilderImpl.java:284)
=A0 =A0 =A0 =A0 at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.= java:180)
=A0 =A0 =A0 =A0 at org.apache.hadoop.conf.Configuration.loadResource(Config= uration.java:1300)
=A0 =A0 =A0 =A0 ... 9 more


--e89a8f3b9f3b4b165504d5046026--