hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-1621) merge tool should work on online cluster, but disabled table
Date Mon, 29 Aug 2011 19:49:39 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jean-Daniel Cryans updated HBASE-1621:
--------------------------------------

    Attachment: online_merge.rb

This is my current WIP on an online merging script.

It requires you download this file and put it on the ruby path (on put it in the folder you
are when running online_merge): http://gitorious.org/trollop/mainline/blobs/raw/master/lib/trollop.rb

(learn more about trollop here: http://trollop.rubyforge.org/)

Currently it:

 - merges whole table or a range of regions
 - skips the regions that are splitting or just split
 - merges any number of regions together, default being 5
 - does a dry run by default

Work needed:

 - a ton of refactoring
 - a log to be able to continue a merge if anything weird happened
 - more smarts on handling splits

We removed thousands of regions already on our clusters with this script (or some older and
buggier version of it).

> merge tool should work on online cluster, but disabled table
> ------------------------------------------------------------
>
>                 Key: HBASE-1621
>                 URL: https://issues.apache.org/jira/browse/HBASE-1621
>             Project: HBase
>          Issue Type: Bug
>            Reporter: ryan rawson
>            Assignee: stack
>            Priority: Blocker
>             Fix For: 0.92.0
>
>         Attachments: 1621-trunk.txt, HBASE-1621-v2.patch, HBASE-1621.patch, hbase-onlinemerge.patch,
online_merge.rb
>
>
> taking down the entire cluster to merge 2 regions is a pain, i dont see why the table
or regions specifically couldnt be taken offline, then merged then brought back up.
> this might need a new API to the regionservers so they can take direction from not just
the master.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message