hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-8541) implement flush-into-stripes in stripe compactions
Date Wed, 25 Sep 2013 23:31:04 GMT

     [ https://issues.apache.org/jira/browse/HBASE-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sergey Shelukhin updated HBASE-8541:
------------------------------------

    Status: Patch Available  (was: Open)
    
> implement flush-into-stripes in stripe compactions
> --------------------------------------------------
>
>                 Key: HBASE-8541
>                 URL: https://issues.apache.org/jira/browse/HBASE-8541
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>         Attachments: HBASE-8541-latest-with-dependencies.patch, HBASE-8541-latest-with-dependencies.patch,
HBASE-8541-latest-with-dependencies.patch, HBASE-8541-v0.patch, HBASE-8541-v1.patch, HBASE-8541-v2.patch
>
>
> Flush will be able to flush into multiple files under this design, avoiding L0 I/O amplification.
> I have the patch which is missing just one feature - support for concurrent flushes and
stripe changes. This can be done via extensive try-locking of stripe changes and flushes,
or advisory flags without blocking flushes, dumping conflicting flushes into L0 in case of
(very rare) collisions. For file loading for the latter, a set-cover-like problem needs to
be solved to determine optimal stripes. That will also address Jimmy's concern of getting
rid of metadata, btw. However currently I don't have time for that. I plan to attach the try-locking
patch first, but this won't happen for a couple weeks probably and should not block main reviews.
Hopefully this will be added on top of main reviews.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message