accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [accumulo] keith-turner opened a new pull request #1389: Always choose volume for new tablet files.
Date Thu, 17 Oct 2019 18:18:22 GMT
keith-turner opened a new pull request #1389: Always choose volume for new tablet files.
URL: https://github.com/apache/accumulo/pull/1389
 
 
   This commit changes Accumulo to always call the volume chooser every time a
   tablet creates a new file.  It also changes the interpretation of the srv:dir
   column in the metadata table.  This column used to contain a URI to a
   directory on a specific volume that was used for all new tablet files. Now the
   srv:dir column only contains a directory name.  This directory name will be
   used for new tablet files across all volumes.
   
   This change necessitated to ~del markers in the metadata table used for
   garbage collection.  When a table is cloned or tablets are merged out of
   existance it can result in ~del markers for tablet dirs being placed in
   the metadata table.  These ~del markers used to reference a specific volume.
   With this change, the ~del marker now use a special URI  of the form
   
     accumulo://allVolumes/accumulo/tables/<tableId>/<dir name>
   
   When the Accumulo GC sees this, it will delete the dir on all configured
   volumes when its no longer used.
   
   This change superceded #642.  These changes are possible because of the
   changes made in #936.
   
   This change in not complete.  There are still some rough edges in GC that need to be smoothed
out.
   Also, upgrade code needs to be written.  Wanted to put this up for feedback before proceeding.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message