hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot
Date Tue, 16 Apr 2013 03:18:28 GMT
I plan to rename ".sanpshot" in HBase to ".hbase-sanpshot"

Please suggest better name in future correspondence.


On Mon, Apr 15, 2013 at 8:12 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Lars:
> I will go ahead and log an HBase JIRA, tomorrow morning.
> This hopefully would give people enough time to respond.
> Cheers
> On Mon, Apr 15, 2013 at 8:00 PM, lars hofhansl <larsh@apache.org> wrote:
>> OK. Let's try to fix that quickly, so that I can release HBase 0.94.7.
>> -- Lars
>> ________________________________
>>  From: Ted Yu <yuzhihong@gmail.com>
>> To: dev@hbase.apache.org; hdfs-dev@hadoop.apache.org
>> Sent: Monday, April 15, 2013 7:13 PM
>> Subject: collision in the naming of '.snapshot' directory between hdfs
>> snapshot and hbase snapshot
>> Hi,
>> This afternoon Huned ad I discovered an issue while playing with HBase
>> Snapshots on top of Hadoop's Snapshot branch (
>> http://svn.apache.org/viewvc/hadoop/common/branches/HDFS-2802/).
>> HDFS (built from HDFS-2802 branch) doesn't allow paths with .snapshot as a
>> component while HBase tries to create paths with .snapshot as a component.
>> This leads to issues in HBase, and one of HDFS or HBase needs to give up
>> the .snapshot reserved keyword. HBase released Snapshots feature in 0.94.6
>> (quite recently) and it may not be too late to change HBase to use a
>> different path component in an upcoming new release.
>> In HBase these path names are not user visible. If there is a deployment
>> of
>> 0.94.6, one could provide a migration tool that renames .snapshot to
>> .hbase-snapshot or something to be able to move to the Snapshot release of
>> Hadoop. On the other hand, .snapshot in HDFS is a user visible name and is
>> a convention that is used by many file systems. It's a matter of
>> familiarity with such path names that would help users in using HDFS
>> snapshots.
>> I am including the hdfs-dev in this email. Would appreciate if we could
>> work together and come up with a solution.
>> You can find sample output from hdfs command here:
>> http://pastebin.com/bBqR4Fvr
>> Cheers

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message