accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Vines (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ACCUMULO-483) Create purge locality utility
Date Thu, 22 Mar 2012 14:50:22 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Vines updated ACCUMULO-483:
--------------------------------

    Assignee:     (was: Billie Rinaldi)
    
> Create purge locality utility
> -----------------------------
>
>                 Key: ACCUMULO-483
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-483
>             Project: Accumulo
>          Issue Type: New Feature
>          Components: client
>            Reporter: John Vines
>            Priority: Minor
>              Labels: newbie
>             Fix For: 1.4.1
>
>
> For some high capacity ingest, the desired path is to do some pre-splits, bulk import,
and then let it naturally split down the rest of the way. If all of the pre-split tablets
made split evenly, then the system will have continuous ranges bundled together on tservers.
This poor distribution can impact performance depending on the operations performed. This
could be handled in the load balancer, but it could be tricky. You don't want to randomly
reassign tablets with any sort of frequency. Rather, you want to do a one-time operation in
doing so. Given the initial assignment code is a bit random (needs to be validated), this
could easily be done by offlining a table, purging all location records for it from the !METADATA
table, and bringing it back online. The balancer will assign the table randomly, at which
point the user could force a major compaction to restablish locality (as well some permanence
in tablet assignment).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message