hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1413) fall back to filesystem block size default if hbase.regionserver.hlog.blocksize is not specified
Date Wed, 13 May 2009 00:16:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708698#action_12708698
] 

stack commented on HBASE-1413:
------------------------------

Yeah, append doesn't work in hadoop, even if I set:

{code}
<property>
  <name>dfs.support.append</name>
  <value>true</value>
  <description>Does HDFS allow appends to files?
               This is currently set to false because there are bugs in the
               "append code" and is not supported in any prodction cluster.
  </description>
</property>
{code}

I set it in hadoop and in hbase-site, just in case.


Here is what happens on recovery (I have hbase default of 1MB blocks):

{code}
2009-05-13 00:11:58,432 [HMaster] DEBUG org.apache.hadoop.hbase.regionserver.HLog: Splitting
7 of 8: hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173414309
2009-05-13 00:11:58,479 [HMaster] DEBUG org.apache.hadoop.hbase.regionserver.HLog: Creating
new log file writer for path hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/TestTable/1990997262/oldlogfile.log
and region TestTable,0452208868,1242173387637
2009-05-13 00:12:03,302 [HMaster] DEBUG org.apache.hadoop.hbase.regionserver.HLog: Applied
104414 total edits from hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173414309
2009-05-13 00:12:03,370 [HMaster] DEBUG org.apache.hadoop.hbase.regionserver.HLog: Splitting
8 of 8: hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173448263
2009-05-13 00:12:10,717 [HMaster] INFO org.apache.hadoop.hbase.regionserver.HLog: log file
splitting completed for hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021
{code}

Nothing is recovered from eight file.....

Let me try printing out log file sizes...

> fall back to filesystem block size default if hbase.regionserver.hlog.blocksize is not
specified
> ------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-1413
>                 URL: https://issues.apache.org/jira/browse/HBASE-1413
>             Project: Hadoop HBase
>          Issue Type: Task
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>             Fix For: 0.19.2, 0.20.0
>
>         Attachments: hbase-1413.patch
>
>
> Fall back to filesystem block size default if hbase.regionserver.hlog.blocksize is not
specified.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message