Return-Path: X-Original-To: apmail-geode-issues-archive@minotaur.apache.org Delivered-To: apmail-geode-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2354718152 for ; Fri, 28 Aug 2015 16:30:49 +0000 (UTC) Received: (qmail 31670 invoked by uid 500); 28 Aug 2015 16:30:49 -0000 Delivered-To: apmail-geode-issues-archive@geode.apache.org Received: (qmail 31641 invoked by uid 500); 28 Aug 2015 16:30:49 -0000 Mailing-List: contact issues-help@geode.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@geode.incubator.apache.org Delivered-To: mailing list issues@geode.incubator.apache.org Received: (qmail 31632 invoked by uid 99); 28 Aug 2015 16:30:49 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Aug 2015 16:30:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 964931AB0C6 for ; Fri, 28 Aug 2015 16:30:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.026 X-Spam-Level: X-Spam-Status: No, score=-4.026 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.006] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id zwTcfWeZsOMy for ; Fri, 28 Aug 2015 16:30:48 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with SMTP id CA56E254F5 for ; Fri, 28 Aug 2015 16:30:47 +0000 (UTC) Received: (qmail 31376 invoked by uid 99); 28 Aug 2015 16:30:47 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Aug 2015 16:30:47 +0000 Date: Fri, 28 Aug 2015 16:30:47 +0000 (UTC) From: "Kirk Lund (JIRA)" To: issues@geode.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (GEODE-292) Optimize speed of backup/ restore cache snapshots MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/GEODE-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720154#comment-14720154 ] Kirk Lund commented on GEODE-292: --------------------------------- Wes, on the far right under People are Assignee and Reporter. Directly under "Unassigned" is "Assign to me" (a link in blue). You can click that to assign to yourself, or if you click on "Unnassigned" it let's you enter a name. I'll assign it to you. > Optimize speed of backup/ restore cache snapshots > ------------------------------------------------- > > Key: GEODE-292 > URL: https://issues.apache.org/jira/browse/GEODE-292 > Project: Geode > Issue Type: Improvement > Components: persistence > Affects Versions: 1.0.0-incubating > Reporter: Wes Williams > Labels: backups, performance > Fix For: 1.0.0-incubating > > Original Estimate: 120h > Remaining Estimate: 120h > > Backup/ restore using snapshots takes a very, very long time when: > 1) There are a lot of PDXTypes, and > 2) There are a lot of regions. > Specifically, it takes 35 minutes to restore only 50MB of unstructured JSON from snapshots. In contrast, it takes only 3 minutes to reload all the data from scratch. > PROBLEM > CacheSnapshot loops all regions and saves all cache PDXTypes in every region.gfd. On restore, it reloads all cache PDXTypes again for every region where they only need to be loaded once. > SOLUTION > This JIRA issue will create an option to save PDXTypes only once and reload them once and store only data in the region snapshots. Existing functionality will remain for those who want it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)