Return-Path: X-Original-To: apmail-hama-dev-archive@www.apache.org Delivered-To: apmail-hama-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D01A610D7B for ; Wed, 25 Sep 2013 23:49:02 +0000 (UTC) Received: (qmail 32687 invoked by uid 500); 25 Sep 2013 23:49:02 -0000 Delivered-To: apmail-hama-dev-archive@hama.apache.org Received: (qmail 32668 invoked by uid 500); 25 Sep 2013 23:49:02 -0000 Mailing-List: contact dev-help@hama.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hama.apache.org Delivered-To: mailing list dev@hama.apache.org Received: (qmail 32659 invoked by uid 99); 25 Sep 2013 23:49:02 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Sep 2013 23:49:02 +0000 Date: Wed, 25 Sep 2013 23:49:02 +0000 (UTC) From: "Hudson (JIRA)" To: dev@hama.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HAMA-805) Problem initializing pipes in HamaStreaming MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HAMA-805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778245#comment-13778245 ] Hudson commented on HAMA-805: ----------------------------- SUCCESS: Integrated in Hama-Nightly-for-Hadoop-2.x #44 (See [https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/44/]) HAMA-805: Problem initializing pipes in HamaStreaming (millecker: rev 1526259) * /hama/trunk/CHANGES.txt * /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/BinaryProtocol.java * /hama/trunk/core/src/main/java/org/apache/hama/pipes/protocol/StreamingProtocol.java > Problem initializing pipes in HamaStreaming > ------------------------------------------- > > Key: HAMA-805 > URL: https://issues.apache.org/jira/browse/HAMA-805 > Project: Hama > Issue Type: Bug > Environment: python 3.2, hadoop2 > Reporter: Edward J. Yoon > Assignee: Martin Illecker > Fix For: 0.6.3 > > Attachments: HAMA-805.patch > > > {code} > Hello all, > I try to use Hama Streaming. > I have successfully installed Hama (the Pi example works). > I follow this tutorial: > http://wiki.apache.org/hama/HamaStreaming > When I try to run the distributed HelloWorld in the local > configuration, I get the following error: > $ bin/hama pipes -streaming true -bspTasks 3 -interpreter python3.2 > -cachefiles /tmp/PyStreaming/*.py -output /tmp/pystream-out/ -program > /tmp/PyStreaming/BSPRunner.py -programArgs HelloWorldBSP > 13/09/23 18:03:50 INFO pipes.Submitter: Streaming enabled! > 13/09/23 18:03:50 WARN util.NativeCodeLoader: Unable to load > native-hadoop library for your platform... using builtin-java classes > where applicable > 13/09/23 18:03:50 WARN bsp.BSPJobClient: No job jar file set. User > classes may not be found. See BSPJob#setJar(String) or check Your jar > file. > 13/09/23 18:03:50 INFO bsp.BSPJobClient: Running job: job_localrunner_0001 > 13/09/23 18:03:50 INFO bsp.LocalBSPRunner: Setting up a new barrier for 3 tasks! > 13/09/23 18:03:50 ERROR bsp.LocalBSPRunner: Exception during BSP execution! > java.lang.NullPointerException > at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) > at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:255) > at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286) > at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > [output cropped] > When I turn to the pseudo-distributed mode, job fails too (after a > minute of execution): > 13/09/23 18:46:34 INFO pipes.Submitter: Streaming enabled! > 13/09/23 18:46:34 WARN util.NativeCodeLoader: Unable to load > native-hadoop library for your platform... using builtin-java classes > where applicable > 13/09/23 18:46:34 WARN bsp.BSPJobClient: No job jar file set. User > classes may not be found. See BSPJob#setJar(String) or check Your jar > file. > 13/09/23 18:46:34 INFO bsp.BSPJobClient: Running job: job_201309231846_0001 > 13/09/23 18:47:40 INFO bsp.BSPJobClient: Job failed. > Task log contains errors: > 13/09/23 18:46:37 INFO ipc.Server: Starting Socket Reader #1 for port 43475 > 13/09/23 18:46:37 INFO ipc.Server: IPC Server Responder: starting > 13/09/23 18:46:37 INFO ipc.Server: IPC Server listener on 43475: starting > 13/09/23 18:46:37 INFO message.HadoopMessageManagerImpl: BSPPeer > address:localhost.localdomain port:43475 > 13/09/23 18:46:37 INFO ipc.Server: IPC Server handler 0 on 43475: starting > 13/09/23 18:46:37 WARN util.NativeCodeLoader: Unable to load > native-hadoop library for your platform... using builtin-java classes > where applicable > 13/09/23 18:46:37 INFO sync.ZKSyncClient: Initializing ZK Sync Client > 13/09/23 18:46:37 INFO sync.ZooKeeperSyncClientImpl: Start connecting > to Zookeeper! At localhost.localdomain/127.0.0.1:43475 > 13/09/23 18:46:37 ERROR bsp.BSPTask: Error running bsp setup and bsp function. > java.lang.NullPointerException > at java.io.File.(File.java:222) > at org.apache.hama.pipes.PipesApplication.setupCommand(PipesApplication.java:130) > at org.apache.hama.pipes.PipesApplication.start(PipesApplication.java:257) > at org.apache.hama.pipes.PipesBSP.setup(PipesBSP.java:44) > at org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176) > at org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) > at org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246) > [output cropped] > I use the latest trunk version of Hama, Python 3.2.5 and Hadoop 2.0.0-cdh4.1.1. > Please help me to figure out the problem. > Thanks in advance, > Roman > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira