hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wakuda_tsut...@intec.co.jp
Subject Is it because the JVM memory is low?
Date Fri, 07 Apr 2017 04:15:39 GMT
Hello.

I am testing HBASE now.

The following problem occurred.

I do not know why this problem occurred.

Is it because the JVM memory is low?
(The memory size of HBASE is the default(1GB).)

Please give me on solution.

(Problem)

When registering data of a 700MiB file, subsequent data registration fails.

(Pseudo-Distributed environment)
HBase : 1.2.4
Hadoop : 2.7.3
java version : 1.8.0_121
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)

(Server)
OS:Red Hat Enterprise Linux Server release 6.7 (Santiago)
 (Linux patdevsrv02 2.6.32-573.el6.x86_64)
CPU:Intel(R) Xeon(R) CPU E5640  @2.67GHz * 2
Memory:12GB
Swap:14GB
Network:1Gbps

(Log)
(1) java_program.log

2017-04-07 11:33:12,056 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t1] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=10, retries=35, started=38618 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:33:22,152 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t1] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=11, retries=35, started=48716 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:34:00,532 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t2] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=10, retries=35, started=38270 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:34:10,547 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t2] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=11, retries=35, started=48284 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:34:49,088 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t3] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=10, retries=35, started=38337 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:34:59,143 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t3] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=11, retries=35, started=48392 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:35:37,840 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t4] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=10, retries=35, started=38256 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
2017-04-07 11:35:47,912 [hconnection-0x4c05f83b-metaLookup-shared--pool2-t4] INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller
: Call exception, tries=11, retries=35, started=48328 ms ago, cancelled=false, msg=row 'test_table,test_key_1,99999999999999'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=example,16201,1491532079385,
seqNum=0
:
:

(2) hbase-test-master-example.log

2017-04-07 11:34:38,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053376 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:39,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053377 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:40,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053378 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:41,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053379 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:42,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053380 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:43,084 INFO  [main-EventThread] coordination.SplitLogManagerCoordination:
task /hbase/splitWAL/RESCAN0000053381 entered state: DONE example,16000,1491532078399
2017-04-07 11:34:44,082 INFO  [example,16000,1491532078399_splitLogManager__ChoreService_1]
master.SplitLogManager: total tasks = 4 unassigned = 4 tasks={/hbase/splitWAL/WALs%2Fexample%2C16201%2C1491532079385-splitting%2Fexample%252C16201%252C1491532079385..meta.1491532095844.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 4 done = 0 error = 0, /hbase/splitWAL/WALs%2Fexample%2C16201%2C1491532079385-splitting%2Fexample%252C16201%252C1491532079385..meta.1491532101210.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 4 done = 0 error = 0, /hbase/splitWAL/WALs%2Fexample%2C16201%2C1491532079385-splitting%2Fexample%252C16201%252C1491532079385..meta.1491532100787.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 4 done = 0 error = 0,
  /hbase/splitWAL/WALs%2Fexample%2C16201%2C1491532079385-splitting%2Fexample%252C16201%252C1491532079385..meta.1491532101137.meta=last_update
= -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits
= 0 batch = installed = 4 done = 0 error = 0}
:
:

Thank you.

Tsutomu Wakuda
 

Mime
View raw message