hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Jungblut <thomas.jungb...@googlemail.com>
Subject Re: Build failed in Jenkins: Hama-Nightly #583
Date Sat, 16 Jun 2012 05:53:23 GMT
Okay we have just two problems now:

12/06/15 23:59:28 WARN bsp.BSPMaster: Could not clear zookeeper nodes.
> java.lang.IllegalArgumentException: Path must start with / character
> 	at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:51)
> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:788)
> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:837)
> 	at org.apache.hama.bsp.BSPMaster.clearZKNodes(BSPMaster.java:514)
> 	at org.apache.hama.bsp.JobInProgress.initTasks(JobInProgress.java:246)


It seems that I have introduced it now, will fix it soon.

However the testcase in graph module is still failing, but the one in
core module is running perfectly well.

> 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Error submitting job
> java.util.concurrent.ExecutionException: java.lang.NullPointerException
> 	at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> 	at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> 	at org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.schedule(SimpleTaskScheduler.java:179)
> 	at org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.run(SimpleTaskScheduler.java:157)
> Caused by: java.lang.NullPointerException
> 	at org.apache.hama.bsp.TaskInProgress.getTaskToRun(TaskInProgress.java:151)
> 	at org.apache.hama.bsp.JobInProgress.obtainNewTask(JobInProgress.java:275)
> 	at org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:233)


I'm going to add a nullcheck and debug output if we reach that, so we
can check the configuration of that hudson and plan our next steps.



2012/6/16 Apache Jenkins Server <jenkins@builds.apache.org>

> See <https://builds.apache.org/job/Hama-Nightly/583/changes>
>
> Changes:
>
> [tjungblut] honor the skipTests flag
>
> [tjungblut] [HAMA-550]: Implementation of Bipartite Matching
>
> [tjungblut] making testcases more robust against state and parallelism
>
> [tjungblut] fixing syncing
>
> [edwardyoon] Remove double whitespaces.
>
> [edwardyoon] Add fail() method again. It was test.
>
> ------------------------------------------
> [...truncated 5238 lines...]
> 12/06/16 00:01:12 INFO bsp.GroomServer: groom start
>
> 12/06/16 00:01:12 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=localhost:21810 sessionTimeout=1200000
> watcher=org.apache.hama.bsp.GroomServer@5c7734
>
> 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/0:0:0:0:0:0:0:1:21810
>
> 12/06/16 00:01:12 INFO server.NIOServerCnxn: Accepted socket connection
> from /0:0:0:0:0:0:0:1:43710
>
> 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Socket connection established
> to localhost/0:0:0:0:0:0:0:1:21810, initiating session
>
> 12/06/16 00:01:12 INFO server.NIOServerCnxn: Client attempting to
> establish new session at /0:0:0:0:0:0:0:1:43710
>
> 12/06/16 00:01:12 INFO bsp.GroomServer: /tmp/hama-test
>
> 12/06/16 00:01:12 INFO ipc.Server: Starting SocketReader
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server Responder: starting
>
> 12/06/16 00:01:12 INFO server.NIOServerCnxn: Established session
> 0x137f297e9f00001 with negotiated timeout 40000 for client
> /0:0:0:0:0:0:0:1:43710
>
> 12/06/16 00:01:12 INFO zookeeper.ClientCnxn: Session establishment
> complete on server localhost/0:0:0:0:0:0:0:1:21810, sessionid =
> 0x137f297e9f00001, negotiated timeout = 40000
>
> 12/06/16 00:01:12 INFO bsp.GroomServer: Worker rpc server -->
> vesta.apache.org:58614
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 0 on 58614: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server listener on 58614: starting
>
> 12/06/16 00:01:12 INFO bsp.GroomServer: starting webserver:
> vesta.apache.org
>
> 12/06/16 00:01:12 INFO http.HttpServer: Port returned by
> webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening
> the listener on 40015
>
> 12/06/16 00:01:12 INFO http.HttpServer: listener.getLocalPort() returned
> 40015 webServer.getConnectors()[0].getLocalPort() returned 40015
>
> 12/06/16 00:01:12 INFO http.HttpServer: Jetty bound to port 40015
>
> 12/06/16 00:01:12 INFO mortbay.log: jetty-6.1.14
>
> 12/06/16 00:01:12 INFO mortbay.log: Extract jar:<
> https://builds.apache.org/job/Hama-Nightly/ws/trunk/core/target/hama-core-0.5.0-SNAPSHOT.jar!/webapp/groomserver/>
> to /tmp/Jetty_vesta_apache_org_40015_groomserver____.ql73sy/webapp
>
> 12/06/16 00:01:12 INFO mortbay.log: Started
> SelectChannelConnector@vesta.apache.org:40015
>
> 12/06/16 00:01:12 INFO ipc.Server: Starting SocketReader
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server Responder: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server listener on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 0 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 1 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 4 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 5 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 3 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 2 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 6 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 8 on 57964: starting
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 9 on 57964: starting
>
> 12/06/16 00:01:12 INFO bsp.GroomServer: GroomServer up at: localhost/
> 127.0.0.1:57964
>
> 12/06/16 00:01:12 INFO bsp.GroomServer: Starting groom:
> vesta.apache.org:58614
>
> 12/06/16 00:01:12 INFO ipc.Server: IPC Server handler 7 on 57964: starting
>
> 12/06/16 00:01:12 INFO bsp.BSPMaster: groomd_vesta.apache.org_58614 is
> added.
>
> 12/06/16 00:01:13 INFO bsp.TestBSPMasterGroomServer: Client finishes
> execution job.
>
> 12/06/16 00:01:13 INFO bsp.FileInputFormat: Total input paths to process :
> 1
>
> 12/06/16 00:01:13 INFO bsp.FileInputFormat: Total # of splits: 2
>
> 12/06/16 00:01:13 WARN bsp.BSPJobClient: No job jar file set.  User
> classes may not be found. See BSPJob#setJar(String) or check Your jar file.
>
> 12/06/16 00:01:13 INFO bsp.JobInProgress: num BSPTasks: 2
>
> 12/06/16 00:01:13 WARN bsp.BSPMaster: Could not clear zookeeper nodes.
> java.lang.IllegalArgumentException: Path must start with / character
>        at
> org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:51)
>        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:788)
>        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:837)
>        at org.apache.hama.bsp.BSPMaster.clearZKNodes(BSPMaster.java:514)
>        at
> org.apache.hama.bsp.JobInProgress.initTasks(JobInProgress.java:246)
>        at org.apache.hama.bsp.QueueManager.initJob(QueueManager.java:45)
>        at
> org.apache.hama.bsp.SimpleTaskScheduler$JobListener.jobAdded(SimpleTaskScheduler.java:116)
>        at org.apache.hama.bsp.BSPMaster.addJob(BSPMaster.java:794)
>        at org.apache.hama.bsp.BSPMaster.submitJob(BSPMaster.java:655)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
>        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
>        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:396)
>        at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
>
> 12/06/16 00:01:13 INFO bsp.JobInProgress: Job is initialized.
>
> 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Error submitting job
> java.util.concurrent.ExecutionException: java.lang.NullPointerException
>        at
> java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
>        at java.util.concurrent.FutureTask.get(FutureTask.java:83)
>        at
> org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.schedule(SimpleTaskScheduler.java:179)
>        at
> org.apache.hama.bsp.SimpleTaskScheduler$JobProcessor.run(SimpleTaskScheduler.java:157)
> Caused by: java.lang.NullPointerException
>        at
> org.apache.hama.bsp.TaskInProgress.getTaskToRun(TaskInProgress.java:151)
>        at
> org.apache.hama.bsp.JobInProgress.obtainNewTask(JobInProgress.java:275)
>        at
> org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:233)
>        at
> org.apache.hama.bsp.SimpleTaskScheduler$TaskWorker.call(SimpleTaskScheduler.java:202)
>        at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>        at java.lang.Thread.run(Thread.java:662)
>
> 12/06/16 00:01:13 INFO bsp.BSPJobClient: Running job: job_201206160001_0001
>
> 12/06/16 00:01:13 ERROR bsp.SimpleTaskScheduler: Scheduling of job
> Pagerank could not be done successfully. Killing it!
>
> 12/06/16 00:01:13 INFO bsp.BSPJobClient: Job failed.
>
> 12/06/16 00:01:13 INFO server.PrepRequestProcessor: Processed session
> termination for sessionid: 0x137f297e9f00000
>
> 12/06/16 00:01:13 INFO zookeeper.ZooKeeper: Session: 0x137f297e9f00000
> closed
>
> 12/06/16 00:01:13 INFO zookeeper.ClientCnxn: EventThread shut down
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 40000
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 40000
>
> 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down
>
> 12/06/16 00:01:13 INFO bsp.BSPMaster: Stopped RPC Master server.
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder
>
> 12/06/16 00:01:13 INFO server.NIOServerCnxn: Closed socket connection for
> client /0:0:0:0:0:0:0:1:43452 which had sessionid 0x137f297e9f00000
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 40000: exiting
>
> 12/06/16 00:01:13 INFO server.PrepRequestProcessor: Processed session
> termination for sessionid: 0x137f297e9f00001
>
> 12/06/16 00:01:13 INFO zookeeper.ZooKeeper: Session: 0x137f297e9f00001
> closed
>
> 12/06/16 00:01:13 INFO server.NIOServerCnxn: Closed socket connection for
> client /0:0:0:0:0:0:0:1:43710 which had sessionid 0x137f297e9f00001
>
> 12/06/16 00:01:13 INFO zookeeper.ClientCnxn: EventThread shut down
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 58614
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 58614: exiting
>
> 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 58614
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping server on 57964
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 1 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 0 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 2 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 3 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 4 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 5 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 7 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 6 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 8 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: IPC Server handler 9 on 57964: exiting
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server listener on 57964
>
> 12/06/16 00:01:13 INFO metrics.RpcInstrumentation: shut down
>
> 12/06/16 00:01:13 INFO ipc.Server: Stopping IPC Server Responder
>
> 12/06/16 00:01:13 INFO server.NIOServerCnxn: NIOServerCnxn factory exited
> run method
>
> 12/06/16 00:01:13 INFO server.PrepRequestProcessor: PrepRequestProcessor
> exited loop!
>
> 12/06/16 00:01:13 INFO server.SyncRequestProcessor: SyncRequestProcessor
> exited!
>
> 12/06/16 00:01:13 INFO server.FinalRequestProcessor: shutdown of request
> processor complete
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec
> <<< FAILURE!
>
> Results :
>
> Failed tests:
>  testSubmitJob(org.apache.hama.graph.TestSubmitGraphJob)
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Hama parent POM ............................ SUCCESS
> [14.276s]
> [INFO] core .............................................. SUCCESS
> [2:06.833s]
> [INFO] graph ............................................. FAILURE [7.637s]
> [INFO] examples .......................................... SKIPPED
> [INFO] yarn .............................................. SKIPPED
> [INFO] machine learning .................................. SKIPPED
> [INFO] hama-dist ......................................... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 2:34.943s
> [INFO] Finished at: Sat Jun 16 00:01:13 UTC 2012
> [INFO] Final Memory: 40M/156M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on
> project hama-graph: There are test failures.
> [ERROR]
> [ERROR] Please refer to <
> https://builds.apache.org/job/Hama-Nightly/ws/trunk/graph/target/surefire-reports>
> for the individual test results.
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hama-graph
> Build step 'Invoke top-level Maven targets' marked build as failure
> Archiving artifacts
> Recording test results
> Updating HAMA-550
>



-- 
Thomas Jungblut
Berlin <thomas.jungblut@gmail.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message