hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-10935) support snapshot policy where flush memstore can be skipped to prevent production cluster freeze
Date Fri, 30 May 2014 15:27:02 GMT

     [ https://issues.apache.org/jira/browse/HBASE-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matteo Bertozzi updated HBASE-10935:
------------------------------------

    Attachment: HBASE-10935-trunk-v1.patch
                HBASE-10935-0.98-v1.patch
                HBASE-10935-0.94-v1.patch

[~tychang] if you are ok, I think I'm going to commit the -v1 set of patches.
it is your patch with a couple of minor changes. Instead of SKIP_FLUSH => "true" with true
as string I switched it to a boolean SKIP_FLUSH => true as the other shell commands are
doing (also the str comparison was wrong, it was = 'true' instead of .eq? 'true' or something
like that)
Then I added the missing .proto that you forgot to include in the patch, and adjusted the
test for trunk since the SnapshotTestUtil has a slightly different api.
so no real changes on the code.

> support snapshot policy where flush memstore can be skipped to prevent production cluster
freeze
> ------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-10935
>                 URL: https://issues.apache.org/jira/browse/HBASE-10935
>             Project: HBase
>          Issue Type: New Feature
>          Components: shell, snapshots
>    Affects Versions: 0.94.7, 0.94.18
>            Reporter: Tianying Chang
>            Assignee: Tianying Chang
>            Priority: Minor
>             Fix For: 0.94.7, 0.99.0, 0.94.20
>
>         Attachments: HBASE-10935-0.94-v1.patch, HBASE-10935-0.98-v1.patch, HBASE-10935-trunk-v1.patch,
hbase-10935-94.patch, hbase-10935-trunk.patch
>
>
> We are using snapshot feature to do HBase disaster recovery. We will do snapshot in our
production cluster periodically. The current flush snapshot policy require all regions of
the table to coordinate to prevent write and do flush at the same time. Since we use WALPlayer
to complete the data that is not in the snapshot HFile, we don't need the snapshot to do coordinated
flush. The snapshot just recored all the HFile that are already there. 
> I added the parameter in the HBase shell. So people can choose to use the NoFlush snapshot
when they need, like below. Otherwise, the default flush snpahot support is not impacted.

> >snaphot 'TestTable', 'TestSnapshot', 'skipFlush'



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message