hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5033) Opening/Closing store in parallel to reduce region open/close time
Date Tue, 20 Dec 2011 06:55:31 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Phabricator updated HBASE-5033:
-------------------------------

    Attachment: D933.2.patch

Liyin updated the revision "[jira][HBASE-5033][[89-fb]]Opening/Closing store in parallel to
reduce region open/close time".
Reviewers: Kannan, mbautin, Karthik, JIRA

  Address Mikhail's comments.
  1) When any exceptions caught during the store/store file open or close time, it would be
safer to shut down the thread pool.
  If not shut down the thread pool for opening, then block cache may have the data related
to the failed opened region.

  If not shut down the thread pool for closing, then the region server may concurrently close
the same store since the closeRegion operation could be retried in the region server.

  2) Use different thread pool for store/store file opening and closing time. So we can shut
down the thread pool separately and no need to worried about the dependency between open and
close.



REVISION DETAIL
  https://reviews.facebook.net/D933

AFFECTED FILES
  src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
  src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
  src/main/java/org/apache/hadoop/hbase/util/Threads.java

                
> Opening/Closing store in parallel to reduce region open/close time
> ------------------------------------------------------------------
>
>                 Key: HBASE-5033
>                 URL: https://issues.apache.org/jira/browse/HBASE-5033
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Liyin Tang
>            Assignee: Liyin Tang
>         Attachments: D933.1.patch, D933.2.patch
>
>
> Region servers are opening/closing each store and each store file for every store in
sequential fashion, which may cause inefficiency to open/close regions. 
> So this diff is to open/close each store in parallel in order to reduce region open/close
time. Also it would help to reduce the cluster restart time.
> 1) Opening each store in parallel
> 2) Loading each store file for every store in parallel
> 3) Closing each store in parallel
> 4) Closing each store file for every store in parallel.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message