hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish Agarwal <ashish.a77...@gmail.com>
Subject Re: Unit tests Failing
Date Thu, 05 May 2011 12:14:20 GMT
Hi,

I experimented with some settings in the hama-site.xml.template and now I am
stuck with this error -


Testsuite: org.apache.hama.bsp.TestBSPPeer
Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 10.625 sec
------------- Standard Error -----------------
11/05/05 06:04:17 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 0 time(s).
11/05/05 06:04:18 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 1 time(s).
11/05/05 06:04:19 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 2 time(s).
11/05/05 06:04:20 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 3 time(s).
11/05/05 06:04:21 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 4 time(s).
11/05/05 06:04:22 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 5 time(s).
11/05/05 06:04:23 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 6 time(s).
11/05/05 06:04:24 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 7 time(s).
11/05/05 06:04:25 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 8 time(s).
11/05/05 06:04:26 INFO ipc.Client: Retrying connect to server: localhost/
127.0.0.1:8020. Already tried 9 time(s).
------------- ---------------- ---------------

Testcase: testSync took 10.597 sec
    Caused an ERROR
Call to localhost/127.0.0.1:8020 failed on connection exception:
java.net.ConnectException: Connection refused
java.net.ConnectException: Call to localhost/127.0.0.1:8020 failed on
connection exception: java.net.ConnectException: Connection refused
    at org.apache.hadoop.ipc.Client.wrapException(Client.java:767)
    at org.apache.hadoop.ipc.Client.call(Client.java:743)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
    at $Proxy0.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
    at
org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
    at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
    at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
    at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
    at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
    at org.apache.hama.HamaTestCase.setUp(HamaTestCase.java:82)
    at
org.apache.hama.HamaClusterTestCase.setUp(HamaClusterTestCase.java:79)
    at org.apache.hama.HamaCluster.setUp(HamaCluster.java:41)
    at org.apache.hama.bsp.TestBSPPeer.setUp(TestBSPPeer.java:62)
Caused by: java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
    at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
    at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:304)
    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:860)
    at org.apache.hadoop.ipc.Client.call(Client.java:720)


I have disabled the firewall, tried using my computer's ip adress instead of
localhost, but it did not work.

Ashish



On Thu, May 5, 2011 at 2:40 AM, Ashish Agarwal <ashish.a77777@gmail.com>wrote:

> It did not make any difference. I noticed that the settings under the
> default folder always get re-written to the default values while running the
> code.
>
> I've attached the hama-env.sh file as well.
>
> Ashish
>
>
>
> On Thu, May 5, 2011 at 2:02 AM, ChiaHung Lin <chl501@nuk.edu.tw> wrote:
>
>> It looks like the unit test is going to test with real cluster setting as
>> specified with hama-site.xml.
>>
>> Can you remove custom setting under conf folder (or use the default value)
>> and re-execute the ant
>> command? It looks like the build process is unit tested with real cluster
>> setting which I think maybe the cause of this issue.
>>
>> -----Original message-----
>> From:Ashish Agarwal<ashish.a77777@gmail.com>
>> To:hama-dev<hama-dev@incubator.apache.org>
>> Date: Thu, 5 May 2011 00:56:58 -0600
>> Subject: Re: Unit tests Failing
>>
>> Hi,
>>
>> I had a look in the /build/report/tests folder and there are only three
>> tests that failed -
>>
>> org.apache.hama.bsp.TestBSPPeer
>> org.apache.hama.bsp.TestSerializePrinting
>> org.apache.hama.bsp.TestBSPMasterGroomServer
>>
>> Each of them shows a timeout error and looks something like this -
>>
>> Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
>>
>> Testcase: testSubmitJob took 0.008 sec
>>     Caused an ERROR
>> Timeout occurred. Please note the time in the report does not reflect the
>> time until the timeout.
>> junit.framework.AssertionFailedError: Timeout occurred. Please note the
>> time in the report does not reflect the time until the timeout.
>>
>>
>> I tried running the command bin/start-bspd.sh and it shows the following
>> output -
>>
>> mydomain.com: ssh: connect to host mydomain.com port 22: Connection timed
>> out
>> starting bspmaster, logging to
>> /home/hadoop/had/hadoop/hama-trunk/bin/../logs/hama-hadoop-bspmaster-ubuntu.out
>> localhost: starting groom, logging to
>> /home/hadoop/had/hadoop/hama-trunk/bin/../logs/hama-hadoop-groom-ubuntu.out
>>
>> It looks like there is something wrong with the hama-site.xml file or with
>> the ssh configuration but I don't know what. I have attached a copy of the
>> file.
>>
>> Thank you,
>>
>> Kind regards
>> Ashish
>>
>>
>> 2011/5/4 Edward J. Yoon <edwardyoon@apache.org>
>> Fyi, you also need to shutdown bsp daemons.
>>
>> Sent from my iPhone
>>
>> On 2011. 5. 4., at 오전 11:29, "ChiaHung Lin" <chl501@nuk.edu.tw> wrote:
>>
>> > I build with trunk and the process works well. Which version are you
>> using?
>> >
>> >    [exec] BUILD SUCCESSFUL
>> >     [exec] Total time: 8 seconds
>> >     [copy] Copying 81 files to /home/user/hama-trunk/build/docs/site
>> >     [copy] Copied 9 empty directories to 3 empty directories under
>> /home/user/hama-trunk/build/docs/site
>> >   [delete] Deleting directory /home/user/hama-trunk/src/docs/build
>> >
>> > BUILD SUCCESSFUL
>> > Total time: 1 minute 37 seconds
>> >
>> > The command used is `ant clean test docs -Dforrest.home=$FORREST_HOME`
>> >
>> > `ant clean test docs -Dforrest.home={$FORREST_HOME}` will throw error
>> because ant can not recognize the variable `{$FORREST_HOME}'
>> >
>> > The error may be
>> >
>> >    Execute failed: java.io.IOException: Cannot run program
>> "{/home/user/apache-forrest-0.9/}/bin/forrest" (in directory
>> "/home/user/hama-trunk/src/docs"): java.io.IOException: error=2, No such
>> file or directory
>> >
>> >
>> > From the error message shown in the mail, it looks like the test case
>> TestSerializePrinting does not get passed. Have you checked the output
>> located under $HAMA_HOME/build/reports/tests/? It might provide more
>> information on what goes wrong.
>> >
>> >
>> > -----Original message-----
>> > From:Ashish Agarwal <ashish.a77777@gmail.com>
>> > To:hama-dev@incubator.apache.org
>> > Date:Tue, 3 May 2011 04:33:42 -0600
>> > Subject:Unit tests Failing
>> >
>> > Hi,
>> >
>> > I am trying to run the Unit tests using the command
>> >
>> > ant clean test docs -Dforrest.home={$FORREST_HOME}
>> >
>> > and the build is failing. The output is -
>> >
>> > Buildfile: /home/hadoop/had/hadoop/hama-trunk/build.xml
>> >
>> > clean:
>> >
>> > pre-init:
>> >    [mkdir] Created dir: /home/hadoop/had/hadoop/hama-trunk/build
>> >    [mkdir] Created dir: /home/hadoop/had/hadoop/hama-trunk/build/classes
>> >    [mkdir] Created dir: /home/hadoop/had/hadoop/hama-trunk/build/test
>> >    [mkdir] Created dir:
>> /home/hadoop/had/hadoop/hama-trunk/build/examples
>> >    [mkdir] Created dir:
>> > /home/hadoop/had/hadoop/hama-trunk/build/reports/tests
>> >    [mkdir] Created dir: /home/hadoop/had/hadoop/hama-trunk/build/lib
>> >     [copy] Copying 15 files to
>> /home/hadoop/had/hadoop/hama-trunk/build/lib
>> >    [touch] Creating /tmp/null1070640997
>> >   [delete] Deleting: /tmp/null1070640997
>> >
>> > eval.reset.conf:
>> >
>> > pre-init-reset-conf:
>> >     [copy] Copying 3 files to /home/hadoop/had/hadoop/hama-trunk/conf
>> >     [copy] Copying
>> > /home/hadoop/had/hadoop/hama-trunk/conf/groomservers.template to
>> > /home/hadoop/had/hadoop/hama-trunk/conf/groomservers
>> >     [copy] Copying
>> > /home/hadoop/had/hadoop/hama-trunk/conf/hama-site.xml.template to
>> > /home/hadoop/had/hadoop/hama-trunk/conf/hama-site.xml
>> >     [copy] Copying
>> > /home/hadoop/had/hadoop/hama-trunk/conf/hama-env.sh.template to
>> > /home/hadoop/had/hadoop/hama-trunk/conf/hama-env.sh
>> >
>> > init:
>> >
>> > compile:
>> >    [mkdir] Created dir: /home/hadoop/had/hadoop/hama-trunk/build/src
>> >    [javac] Compiling 77 source files to
>> > /home/hadoop/had/hadoop/hama-trunk/build/classes
>> >
>> > compile-test:
>> >    [javac] Compiling 15 source files to
>> > /home/hadoop/had/hadoop/hama-trunk/build/test
>> >      [jar] Building jar:
>> > /home/hadoop/had/hadoop/hama-trunk/build/hama-0.3.0-test.jar
>> >
>> > test:
>> >    [junit] Running org.apache.hama.bsp.TestBSPMasterGroomServer
>> >    [junit] Running org.apache.hama.bsp.TestBSPMasterGroomServer
>> >    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
>> >    [junit] Test org.apache.hama.bsp.TestBSPMasterGroomServer FAILED
>> > (timeout)
>> >    [junit] Running org.apache.hama.bsp.TestBSPMessageBundle
>> >    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.033 sec
>> >    [junit] Running org.apache.hama.bsp.TestBSPPeer
>> >    [junit] Running org.apache.hama.bsp.TestBSPPeer
>> >    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
>> >    [junit] Test org.apache.hama.bsp.TestBSPPeer FAILED (timeout)
>> >    [junit] Running org.apache.hama.bsp.TestClusterStatus
>> >    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.205 sec
>> >    [junit] Running org.apache.hama.bsp.TestSerializePrinting
>> >    [junit] Running org.apache.hama.bsp.TestSerializePrinting
>> >    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
>> >    [junit] Test org.apache.hama.bsp.TestSerializePrinting FAILED
>> (timeout)
>> >    [junit] Running org.apache.hama.ipc.TestIPC
>> >    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 12.127
>> sec
>> >    [junit] Running org.apache.hama.ipc.TestRPC
>> >    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec
>> >    [junit] Running org.apache.hama.util.TestBytes
>> >    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.145 sec
>> >    [junit] Running org.apache.hama.util.TestNumeric
>> >    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.121 sec
>> >    [junit] Running org.apache.hama.util.TestRandomVariable
>> >    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.009 sec
>> >
>> > BUILD FAILED
>> > /home/hadoop/had/hadoop/hama-trunk/build.xml:329: Tests failed!
>> >
>> > Total time: 30 minutes 24 seconds
>> >
>> >
>> > Kind Regards,
>> > Ashish
>> >
>> >
>> > --
>> > ChiaHung Lin
>> > Department of Information Management
>> > National University of Kaohsiung
>> > Taiwan
>>
>>
>>
>> --
>> ChiaHung Lin
>> Department of Information Management
>> National University of Kaohsiung
>> Taiwan
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message