hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject Re: need to make fsync=1 flush faster
Date Mon, 31 Aug 2009 08:01:16 GMT
This is HBASE-1416.

   - Andy

From: Ryan Rawson <ryanobjc@gmail.com>
To: hbase-dev@hadoop.apache.org
Sent: Sunday, August 30, 2009 10:47:58 PM
Subject: need to make fsync=1 flush faster

we need to make hlog flush faster, it currently does only 700 ops/sec
when we flush every entry.

it'd be nice if we could do something clever, such as:

- use multiple logs
- detect multiple waiting clients and better batch their commits
- group commits for bulk import

anything else?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message