accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey" <s...@manvsbeard.com>
Subject Re: Review Request 19804: ACCUMULO-2519 Aborts upgrade if there are Fate transactions from an old version.
Date Fri, 04 Apr 2014 22:28:24 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19804/
-----------------------------------------------------------

(Updated April 4, 2014, 10:28 p.m.)


Review request for accumulo and kturner.


Bugs: ACCUMULO-2519
    https://issues.apache.org/jira/browse/ACCUMULO-2519


Repository: accumulo


Description
-------

Adds "make sure Fate has no outstanding items" to the upgrade instructions. Makes sure the
master and tabletservers don't take upgrade steps if they see fate ops waiting.


Diffs
-----

  README 115a9b7 
  server/src/main/java/org/apache/accumulo/server/Accumulo.java 99ec7e4 
  server/src/main/java/org/apache/accumulo/server/master/Master.java 8c4c864 
  server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java d76946d 
  server/src/main/java/org/apache/accumulo/server/util/MetadataTable.java 7328a55 

Diff: https://reviews.apache.org/r/19804/diff/


Testing (updated)
-------

Took a 1.4.5-SNAP cluster

* loaded test data in a variety of table configs
* alternate table creation and deletion
* load additional table to cause !METADATA churn
* shutdown cluster uncleanly
* verified waiting Fate transactions (table deletion at success status)
* verified waiting local WALs
* verified waiting local WALs include !METADATA table (via LogReader)
* verified /accumulo/version showed 4
* Start upgrade to 1.5.2-SNAP
* verified errors showing no upgrade and to go back to docs in: monitor, master logs, tabletserver
logs
* verified same waiting Fate transactions
* verified same waiting local WALs
* verified /accumulo/version showed 4
* Cleared Fate operations
* Start upgrade to 1.5.2-SNAP
* wait a terrifying long amount of time, check on progress via local logs
* verify no errors shown for upgrade
* verified WALs copied to HDFS
* verified /accumulo/version showed 5
* verified monitor showed normal start up
* wait for all tablets to be hosted
* verify test data

After merging forward to 1.6.0-SNAPSHOT branch:

Took 1.5.2-SNAP cluster from above test

* loaded additional test data in same variety of table configs
* queue compactions from shell
* load additional table to cause !METADATA churn
* shutdown cluster uncleanly
* verified waiting Fate transactions (compactions)
* verified WALs in HDFS
* verified WALs include !METADATA table (via LogReader)
* verified /accumulo/version showed 5
* Start upgrade to 1.6.0-SNAP
* verified errors showing no upgrade and to go back to docs in: monitor, master logs
* verified same waiting Fate transactions
* verified same waiting hdfs WALs
* verified /accumulo/version showed 5
* Cleared Fate operations
* start upgrade to 1.6.0-SNAP
* Wait a good deal of time, though not as long as last time (largely for recover of ~7GB of
WALs)
* verify no errors shown for upgrade
* verified /accumulo/version showed 6
* verify restart cluster post-upgrade doesn't upgrade
* verified monitor showed normal start up
* waited for all tablets to be hosted
* verify test data (both 1.4 written and 1.5 written)


Thanks,

Sean Busbey


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message