aurora-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David McLaughlin (JIRA)" <>
Subject [jira] [Created] (AURORA-1861) Remove duplicate Snapshot fields for DB stores
Date Thu, 15 Dec 2016 05:50:59 GMT
David McLaughlin created AURORA-1861:

             Summary: Remove duplicate Snapshot fields for DB stores
                 Key: AURORA-1861
             Project: Aurora
          Issue Type: Task
          Components: Scheduler
            Reporter: David McLaughlin

Currently we double-write any DB-backed stores into a Snapshot struct when creating a Snapshot.
This inflates the size of the Snapshot, which is already a problem for large production clusters
(see AURORA-74). 

Example for LockStore from
      new SnapshotField() {
        // It's important for locks to be replayed first, since there are relations that expect
        // references to be valid on insertion.
        public void saveToSnapshot(MutableStoreProvider store, Snapshot snapshot) {

        public void restoreFromSnapshot(MutableStoreProvider store, Snapshot snapshot) {
          if (hasDbSnapshot(snapshot)) {
  "Deferring lock restore to dbsnapshot");


          if (snapshot.isSetLocks()) {
            for (Lock lock : snapshot.getLocks()) {

Note: one major side-effect here is if anyone is trying to read these snapshots and utilize
the data outside of Java - they'll lose the ability to process the data without being able
to apply the DB script. 

This message was sent by Atlassian JIRA

View raw message