hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jun zhang <zhangjun.jul...@gmail.com>
Subject Re: Use vaidya but error in parsing conf file
Date Wed, 06 Feb 2013 01:37:58 GMT
You can find it with google "vaidya github hadoop"

link is https://github.com/facebook/hadoop-20/tree/master/src/contrib/vaidya

But these is only 5 rules will be checked.

It was not   as useful as I wished.

And my problem is fixed by change file://home to file:/home



2013/2/5 Dhanasekaran Anbalagan <bugcy013@gmail.com>

> Hi jun,
>
> I am very much interested with vaidya project. to analysis the mapreduce
> job, output. I read some weblinks, We have already using CDH4, where you
> can get from source vaidya. Please guide me How to test my MR jon to vaidya.
>
> -Dhanasekaran
>
> Did I learn something today? If not, I wasted it.
>
>
> On Mon, Feb 4, 2013 at 2:15 AM, jun zhang <zhangjun.julian@gmail.com>wrote:
>
>> I’m try to use vaidya to check my mr job, but always get the error
>> info like the below
>>
>> what's the home here? Need I setting any things
>>
>>  ./vaidya_new.sh -jobconf
>> file://home/jt1_1359122958375_job_201301252209_1384_conf.xml -joblog
>> file://home/job_201301252209_1384_1359959201318_b  -testconf
>> /opt/hadoop/contrib/vaidya/conf/postex_diagnosis_tests.xml -report
>> ./report.xml
>>
>> 13/02/04 15:06:04 FATAL conf.Configuration: error parsing conf file:
>> java.net.UnknownHostException: home
>> Exception:java.lang.RuntimeException: java.net.UnknownHostException:
>> homejava.lang.RuntimeException: java.net.UnknownHostException: home
>>         at
>> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1395)
>>         at
>> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1269)
>>         at
>> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1200)
>>         at
>> org.apache.hadoop.conf.Configuration.get(Configuration.java:501)
>>         at
>> org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:131)
>>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:242)
>>         at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:225)
>>         at
>> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.readJobInformation(PostExPerformanceDiagnoser.java:138)
>>         at
>> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.<init>(PostExPerformanceDiagnoser.java:112)
>>         at
>> org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:220)
>> Caused by: java.net.UnknownHostException: home
>>         at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:177)
>>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>>         at java.net.Socket.connect(Socket.java:529)
>>         at java.net.Socket.connect(Socket.java:478)
>>         at sun.net.NetworkClient.doConnect(NetworkClient.java:163)
>>         at sun.net.NetworkClient.openServer(NetworkClient.java:118)
>>         at sun.net.ftp.FtpClient.openServer(FtpClient.java:488)
>>         at sun.net.ftp.FtpClient.openServer(FtpClient.java:475)
>>         at
>> sun.net.www.protocol.ftp.FtpURLConnection.connect(FtpURLConnection.java:270)
>>         at
>> sun.net.www.protocol.ftp.FtpURLConnection.getInputStream(FtpURLConnection.java:352)
>>         at
>> com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:653)
>>         at
>> com.sun.org.apache.xerces.internal.impl.XMLVersionDetector.determineDocVersion(XMLVersionDetector.java:186)
>>         at
>> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:772)
>>         at
>> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
>>         at
>> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
>>         at
>> com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:235)
>>         at
>> com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:284)
>>         at
>> javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:180)
>>         at
>> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1300)
>>         ... 9 more
>>
>
>

Mime
View raw message