hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liyin Tang (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5033) Opening/Closing store in parallel to reduce region open/close time
Date Thu, 12 Jan 2012 00:06:40 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liyin Tang updated HBASE-5033:
------------------------------

    Attachment: HBASE-5033-apach-trunk.patch

1) Based on the recent trunk and generate the patch --no-prefix
2) The default number of thread is set to 1.
3) Performance evaluation: the performance will be vary for different cluster environment
such as the number of regions and the number of store files for each region.

The simple restart test shows the single region server (22 regions) restart time decreased
from 78 sec to 55 sec 
So this will roughly save about 29% region server restart time. Also the cluster (100 nodes)
restart time decreased from 316 secs to 189 secs, which has saved around 40% restart time.


                
> Opening/Closing store in parallel to reduce region open/close time
> ------------------------------------------------------------------
>
>                 Key: HBASE-5033
>                 URL: https://issues.apache.org/jira/browse/HBASE-5033
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Liyin Tang
>            Assignee: Liyin Tang
>         Attachments: 5033.txt, D933.1.patch, D933.2.patch, D933.3.patch, D933.4.patch,
D933.5.patch, HBASE-5033-apach-trunk.patch
>
>
> Region servers are opening/closing each store and each store file for every store in
sequential fashion, which may cause inefficiency to open/close regions. 
> So this diff is to open/close each store in parallel in order to reduce region open/close
time. Also it would help to reduce the cluster restart time.
> 1) Opening each store in parallel
> 2) Loading each store file for every store in parallel
> 3) Closing each store in parallel
> 4) Closing each store file for every store in parallel.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message