hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14575) Reduce scope of compactions holding region lock
Date Tue, 17 Nov 2015 03:02:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007915#comment-15007915
] 

Ted Yu commented on HBASE-14575:
--------------------------------

>From https://builds.apache.org/job/PreCommit-HBASE-Build/16539//testReport/org.apache.hadoop.hbase.regionserver/TestHRegionServerBulkLoad/testAtomicBulkLoad_1_/
:
{code}
java.lang.RuntimeException: Deferred
  at org.apache.hadoop.hbase.MultithreadedTestUtil$TestContext.checkException(MultithreadedTestUtil.java:78)
  at org.apache.hadoop.hbase.MultithreadedTestUtil$TestContext.stop(MultithreadedTestUtil.java:105)
  at org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad.runAtomicBulkloadTest(TestHRegionServerBulkLoad.java:378)
  at org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad.testAtomicBulkLoad(TestHRegionServerBulkLoad.java:353)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36,
exceptions:
Tue Nov 17 01:33:37 UTC 2015, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=77968:
row '' on table 'atomicBulkLoad' at region=atomicBulkLoad,,           1447723922183.4b02772004db4147b2144c3820b9182a.,
hostname=pietas.apache.org,41039,1447723918534, seqNum=2

  at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:269)
  at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:195)
  at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:59)
  at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:185)
  at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:311)
  at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:286)
  at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:162)
  at org.apache.hadoop.hbase.client.ClientScanner.&lt;init>(ClientScanner.java:155)
  at org.apache.hadoop.hbase.client.ClientSimpleScanner.&lt;init>(ClientSimpleScanner.java:40)
  at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:378)
  at org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad$AtomicScanReader.doAnAction(TestHRegionServerBulkLoad.java:283)
  at org.apache.hadoop.hbase.MultithreadedTestUtil$RepeatingTestThread.doWork(MultithreadedTestUtil.java:147)
  at org.apache.hadoop.hbase.MultithreadedTestUtil$TestThread.run(MultithreadedTestUtil.java:123)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=77968: row ''
on table 'atomicBulkLoad' at region=atomicBulkLoad,,1447723922183.                      4b02772004db4147b2144c3820b9182a.,
hostname=pietas.apache.org,41039,1447723918534, seqNum=2
  at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:151)
  at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: callId=6337, method=Scan, rpcTimeout=10000,
param {region { type: REGION_NAME value: "atomicBulkLoad,,1447723922183. 4b02772004db4147b2144c3820b9182a."
} scan { column { family: "family_0000" } column { family: "family_0001" } column { family:
"family_0002" } column { family: "family_0003" }   column { family: "family_0004" } column
{ family: "family_0005" } column { family: "family_0006" } column { family: "family_0007"
} column { family: "family_0008" } column {     family: "family_0009" } max_versions: 1 cache_blocks:
true max_result_size: 2097152 caching: 2147483647 } number_of_rows: 0 close_scanner: false
client_handles_partials: true    client_handles_heartbeats: true track_scan_metrics: false}
  at org.apache.hadoop.hbase.ipc.AsyncRpcClient.call(AsyncRpcClient.java:257)
  at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:217)
  at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:295)
  at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:33872)
  at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:390)
  at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:199)
{code}

> Reduce scope of compactions holding region lock
> -----------------------------------------------
>
>                 Key: HBASE-14575
>                 URL: https://issues.apache.org/jira/browse/HBASE-14575
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Compaction, regionserver
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>         Attachments: 14575-test-case.patch, 14575-v1.patch, 14575-v2.patch, 14575-v3.patch,
14575-v4.patch, 14575-v5.patch, 14575-v6.txt, 14575-v6.txt, 14575.v00.patch
>
>
> Per [~devaraj]'s idea on parent issue, let's see if we can reduce the scope of critical
section under which compactions hold the region read lock.
> Here is summary from parent issue:
> Another idea is we can reduce the scope of when the read lock is held during compaction.
In theory the compactor only needs a region read lock while deciding what files to compact
and at the time of committing the compaction. We're protected from the case of region close
events because compactions are checking (every 10k bytes written) if the store has been closed
in order to abort in such a case.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message