hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-17738) BucketCache startup is slow
Date Mon, 08 May 2017 09:56:04 GMT

     [ https://issues.apache.org/jira/browse/HBASE-17738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ramkrishna.s.vasudevan updated HBASE-17738:
-------------------------------------------
    Attachment: HBASE-17738.patch

Patch that speeds up the start up process of bucket cache.
75G bucket cache just starts in 7 secs whereas previously it takes 24 secs.
100G bucket cache starts in 10 secs whereas it took 40secs previously.

Added a TODO in the patch to see if we need to make things configurable regarding the thread
pool that does this init.
Will once try this FileMMap engine to see what happens if parallely we try to allocate mmaped
BBs.

> BucketCache startup is slow
> ---------------------------
>
>                 Key: HBASE-17738
>                 URL: https://issues.apache.org/jira/browse/HBASE-17738
>             Project: HBase
>          Issue Type: Sub-task
>          Components: BucketCache
>            Reporter: stack
>            Assignee: ramkrishna.s.vasudevan
>         Attachments: HBASE-17738.patch
>
>
> If you set bucketcache size at 64G say and then start hbase, it takes a long time. Can
we do the allocations in parallel and not inline with the server startup?
> Related, prefetching on a bucketcache is slow. Speed it up.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message