hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chia-Ping Tsai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17738) BucketCache startup is slow
Date Wed, 10 May 2017 17:07:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005025#comment-16005025
] 

Chia-Ping Tsai commented on HBASE-17738:
----------------------------------------

{code}
+      List<Future<ByteBuffer>> futures = new ArrayList<Future<ByteBuffer>>(bufferCount
- 1);
+      for (int i = 0; i <= bufferCount; i++) {
+        if (i < bufferCount) {
+          futures.add(
+            service.submit(new BufferCreatorCallable(allocator, bufferSize, directByteBuffer)));
+        } else {
+          // always create on heap
+          buffers[i] = ByteBuffer.allocate(0);
+        }
+      }
{code}
The initial capacity of futures should be equal with bufferCount rather than "bufferCount
- 1"

> BucketCache startup is slow
> ---------------------------
>
>                 Key: HBASE-17738
>                 URL: https://issues.apache.org/jira/browse/HBASE-17738
>             Project: HBase
>          Issue Type: Sub-task
>          Components: BucketCache
>    Affects Versions: 2.0.0
>            Reporter: stack
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-17738_2.patch, HBASE-17738_2.patch, HBASE-17738.patch
>
>
> If you set bucketcache size at 64G say and then start hbase, it takes a long time. Can
we do the allocations in parallel and not inline with the server startup?
> Related, prefetching on a bucketcache is slow. Speed it up.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message