hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tianying Chang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-10935) support snapshot policy where flush memstore can be skipped to prevent production cluster freeze
Date Sat, 26 Apr 2014 04:35:15 GMT

     [ https://issues.apache.org/jira/browse/HBASE-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tianying Chang updated HBASE-10935:
-----------------------------------

    Attachment: HBase-10935.patch

New patch has tow more things:
1. unit test added. I put the test in TestFlushSnapshotFromClient.java instead of creating
a new dedicated file since it really just one call with one parameter change. Feels no need
for extra duplicated code. 
2. Changed the interface to use {SKIP_FLUSH => 'true'}

I will add patch for trunk in the last step after the patch for 0.94 is considered fine. 

> support snapshot policy where flush memstore can be skipped to prevent production cluster
freeze
> ------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-10935
>                 URL: https://issues.apache.org/jira/browse/HBASE-10935
>             Project: HBase
>          Issue Type: New Feature
>          Components: shell, snapshots
>    Affects Versions: 0.94.7, 0.94.18
>            Reporter: Tianying Chang
>            Assignee: Tianying Chang
>            Priority: Minor
>             Fix For: 0.94.20
>
>         Attachments: HBase-10935.patch, HBase-10935.patch
>
>
> We are using snapshot feature to do HBase disaster recovery. We will do snapshot in our
production cluster periodically. The current flush snapshot policy require all regions of
the table to coordinate to prevent write and do flush at the same time. Since we use WALPlayer
to complete the data that is not in the snapshot HFile, we don't need the snapshot to do coordinated
flush. The snapshot just recored all the HFile that are already there. 
> I added the parameter in the HBase shell. So people can choose to use the NoFlush snapshot
when they need, like below. Otherwise, the default flush snpahot support is not impacted.

> >snaphot 'TestTable', 'TestSnapshot', 'skipFlush'



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message