Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-ID: <53F4BAC9.70803@zfabrik.de>
Date: Wed, 20 Aug 2014 17:12:09 +0200
From: Henning Blohm <henning.blohm@zfabrik.de>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.0
MIME-Version: 1.0
To: user@hbase.apache.org
Subject: Re: delete ".corrupt" folder?
References: 
 <CAGES91kLdvWMXp7O2SfOFy-j+F_mVpdeuuVWumCf0pKSf5RQ5w@mail.gmail.com>
 <53F4B0CB.50701@zfabrik.de>
 <CAPQV63XVhXMcSg302Hdi9Ka2A7XzzepMyqDN8DbBTkZKOc4KAA@mail.gmail.com>
In-Reply-To: 
 <CAPQV63XVhXMcSg302Hdi9Ka2A7XzzepMyqDN8DbBTkZKOc4KAA@mail.gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Ah.. man.. sorry for the confusion: Just noted that the terminal was 
still open. Here's the output from the delete:

$ hadoop fs -rmr /hbase/.corrupt/*
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1406915392963
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1407034197420
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1407246602219
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1407770546240
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1407773074652
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1407773969678
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241347935
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241348470
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241348677
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241349446
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241349732
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241350291
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241350733
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241351260
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408241351469
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408244952906
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408450158299
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408450158313
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408477692983
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408481294207
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408481294227
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408481294237
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408481294245
Deleted hdfs://localhost:9000/hbase/.corrupt/localhost%3A60020.1408481294257

Does that say anything to you?

Thanks,
Henning

On 08/20/2014 04:43 PM, Jean-Marc Spaggiari wrote:
> Can you list the files you have under this directory?
>
> Look at 9.6.5.3.1 in http://hbase.apache.org/book/regionserver.arch.html
>
> They might be corrupt logs files that we can not replay. So might be safe
> to remove, but you might have some data lost there...
>
> JM
>
>
>
> 2014-08-20 10:29 GMT-04:00 Henning Blohm <henning.blohm@zfabrik.de>:
>
>> Nobody?
>>
>> Well... I will try and see what happens...
>>
>> Thanks,
>> Henning
>>
>>
>> On 08/11/2014 09:28 PM, Henning Blohm wrote:
>>
>>> Lately, on a single node test installation, I noticed that the
>>> Hadoop/Hbase folder /hbase/.corrupt got quite big (probably due to failed
>>> log splitting due to lack of disk space).
>>>
>>> Is it safe to simply delete that folder?
>>>
>>> And, what would one possibly do with those problematic WAL logs?
>>>
>>> Thanks,
>>> Henning
>>>
>>