incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: how to debug bsp jobs in hama
Date Wed, 08 Jun 2011 11:36:12 GMT
> Maybe Hama can add more features for debug. For example the feature
> similar with org.apache.hadoop.mapred.IsolationRunner and so on.

Yes that's good idea.

Please feel free file a JIRA and Patch!

On Wed, Jun 8, 2011 at 3:36 PM, Fancy Yin <yfxhust@gmail.com> wrote:
> Hi, Edward:
>
> Thank you for your suggestion!
>
> I noticed the issue:
> https://issues.apache.org/jira/browse/HAMA-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>
> So it is as same as Hadoop! I will try it!
>
> Maybe Hama can add more features for debug. For example the feature
> similar with org.apache.hadoop.mapred.IsolationRunner and so on.
>
> B.R.
> Fancy
>
> 2011/6/8, Edward J. Yoon <edwardyoon@apache.org>:
>> Hi,
>>
>> There's a thread-based 'LocalBSPRunner'. It can be useful to debug.
>>
>> On Wed, Jun 8, 2011 at 11:10 AM, Fancy Yin <yfxhust@gmail.com> wrote:
>>> Hello:
>>>
>>> I am new to distributed system.
>>>
>>> When I tried to write some experimental
>>> code with Hama, I met one problem:how to debug a BSP job in Hama
>>> pseudo-distributed environment.
>>>
>>> From code, I know that GroomServer child task is spawned like this:
>>>
>>> this.process = Runtime.getRuntime().exec(args, null, dir);
>>>
>>> This is a child process. In Netbeans, I run the job as main process.
>>> For the main process, I can make breakpoint and debug it in any way.
>>> But for the child process, what should I do if I want to debug it ?
>>> How can I make sure whether there is some mistake in my bsp job.
>>>
>>> or maybe there is another way to debug it not in pseudo-distributed
>>> environment?
>>>
>>> My development environment is a pseudo-distributed enviroment.
>>> BSPMasterRunner process and GroomServerRunner are in the same
>>> computer.
>>>
>>> The following is my process snapshot when I run my bsp job.
>>>
>>> 5087 HRegionServer
>>> 25763 GroomServer$Child
>>> 16258 Main
>>> 22918 BSPMasterRunner
>>> 4653 TaskTracker
>>> 4412 SecondaryNameNode
>>> 4839 QuorumPeerMain
>>> 4490 JobTracker
>>> 25930 Jps
>>> 25694 Main
>>> 4933 HMaster
>>> 4247 DataNode
>>> 4060 NameNode
>>> 23055 GroomServerRunner
>>>
>>> I will appreciate u very much if you can give me some suggestions.
>>>
>>> B.R.
>>> Fancy
>>>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message