hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-4044) [performance]decrease IO calls when flush hlog
Date Mon, 07 Nov 2011 15:16:51 GMT

     [ https://issues.apache.org/jira/browse/HBASE-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jean-Daniel Cryans updated HBASE-4044:
--------------------------------------

    Fix Version/s:     (was: 0.90.4)

Removing the fix version as it wasn't fixed anywhere.
                
> [performance]decrease IO calls when flush hlog
> ----------------------------------------------
>
>                 Key: HBASE-4044
>                 URL: https://issues.apache.org/jira/browse/HBASE-4044
>             Project: HBase
>          Issue Type: Improvement
>          Components: performance, regionserver
>            Reporter: mingjian
>         Attachments: HLog-trunk-v1.patch
>
>
>     We found that the hlog flush to disk would block other write threads. When one thread
exec "doWrite(info, logKey, edit);", the others wait for "updateLock" in HLog.java.
>     Why not the others add their edits into a list and wait. When sync's time, the whole
list sync to disk once. I think it will decrease the IO calls. 
>     So Maybe we will make two lists for edits. Each thread write to the "waledits" and
wait for "updateLock". Each thread can copy the "waledits" to "flushedits" and flush the "flushedits"
to disk once it gets "updateLock".
>     In my test, it can increase the write speed of 100% when I set "hbase.regionserver.handler.count"=100.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message