hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: HBase performance evaluation master not running problem.
Date Sat, 22 Jan 2011 00:36:21 GMT
Then its odd that PE fails.  Can you figure difference between the two
environments?  Perhaps your MR jobs are fat jars that include the conf
and all dependencies whereas PE is dump and expects the dependencies
and conf on CLASSPATH?

St.Ack

On Fri, Jan 21, 2011 at 11:56 AM, Wojciech Langiewicz
<wlangiewicz@gmail.com> wrote:
> Hi,
> I have other mapreduce tasks that are running on this cluster and using
> HBase and they are working correctly. All my servers have the same
> configuration.
>
> --
> Wojciech Langiewicz
>
> On 21.01.2011 19:20, Stack wrote:
>>
>> When clients are>  1, then PE tries to run a mapreduce job to host the
>> loading clients.
>>
>> Is it possible that the client out in MR task is trying to connect to
>> wrong location?  Perhaps the HBase conf dir is not available to the
>> running task?  Have you seen
>>
>> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description?
>>  Perhaps this will help?
>>
>> St.Ack
>>
>> On Fri, Jan 21, 2011 at 8:12 AM, Wojciech Langiewicz
>> <wlangiewicz@gmail.com>  wrote:
>>>
>>> Hello
>>> I have problem with running HBase performance tests from
>>> org.apache.hadoop.hbase.PerformanceEvaluation package. I'm using version
>>> from CDH3,
>>> Tests are ok when argument nclients is 1, but in case of greater number,
>>> after mappers reaching 100% I get this exception (I didn't test all
>>> tests,
>>> but all of tested by me failed, 'scan' and 'randomRead' fail for sure):
>>>
>>> 11/01/21 17:05:19 INFO mapred.JobClient: Task Id :
>>> attempt_201101211442_0005_m_000000_0, Status : FAILED
>>> org.apache.hadoop.hbase.MasterNotRunningException
>>>        at
>>>
>>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getMaster(HConnectionManager.java:416)
>>>        at
>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:78)
>>>        at
>>>
>>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.testSetup(PerformanceEvaluation.java:745)
>>>        at
>>>
>>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:764)
>>>        at
>>>
>>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1097)
>>>        at
>>>
>>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:446)
>>>        at
>>>
>>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:399)
>>>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>>>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:639)
>>>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:315)
>>>        at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
>>>        at java.security.AccessController.doPrivileged(Native Method)
>>>        at javax.security.auth.Subject.doAs(Subject.java:396)
>>>        at
>>>
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1063)
>>>        at org.apache.hadoop.mapred.Child.main(Child.java:211)
>>>
>>> Do you have any ideas how to solve this?
>>>
>>> --
>>> Wojciech Langiewicz
>>>
>
>

Mime
View raw message