Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2CAE2200BD5 for ; Thu, 8 Dec 2016 20:24:55 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2AA90160B1F; Thu, 8 Dec 2016 19:24:55 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 72BF2160B0A for ; Thu, 8 Dec 2016 20:24:54 +0100 (CET) Received: (qmail 8010 invoked by uid 500); 8 Dec 2016 19:24:53 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Received: (qmail 7998 invoked by uid 99); 8 Dec 2016 19:24:53 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2016 19:24:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DA82E1A0943 for ; Thu, 8 Dec 2016 19:24:52 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.719 X-Spam-Level: X-Spam-Status: No, score=-0.719 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=messagingengine.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id XfAPWAjYRcaV for ; Thu, 8 Dec 2016 19:24:52 +0000 (UTC) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 750165FB36 for ; Thu, 8 Dec 2016 19:24:51 +0000 (UTC) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 810A120769 for ; Thu, 8 Dec 2016 14:24:47 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Thu, 08 Dec 2016 14:24:47 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc:x-sasl-enc; s= smtpout; bh=6J2YEwusOsGcokAgq+LijtPt6qs=; b=HwLeTxH47/aMDPQ/emJF zAwpXAG/MdHM04GZJme6uq7lvjF3Bv0ZWPIUt5tZJ8MoFyvtoNAyoMCZhaZjHTH/ tVznilhZxm5SqM9K0Azv1+VSqyn9jvWFuE89BAoIs0uBGtSxo4ZzrMPdNT6ShYta /5Z0/G1BaKYDJqM7+0XitqI= X-ME-Sender: X-Sasl-enc: 2LQQza+JZb4frKpkMfnvmTSTwuUmETYJeAjCMAFb9mwA 1481225087 Received: from kocolosk.cambridge.ibm.com (bi-03pt2.bluebird.ibm.com [129.42.208.173]) by mail.messagingengine.com (Postfix) with ESMTPA id 500C224431 for ; Thu, 8 Dec 2016 14:24:47 -0500 (EST) From: Adam Kocoloski Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.1 \(3251\)) Subject: Re: Backup for 2.x Date: Thu, 8 Dec 2016 14:24:46 -0500 References: To: "dev@couchdb.apache.org Developers" In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3251) archived-at: Thu, 08 Dec 2016 19:24:55 -0000 Kinda. Yes, every file in the shards folder is using the same basic = copy-on-write file format as v1. The challenge is that a single logical = database has multiple physical shards potentially spread across multiple = hosts. Capturing the state of each of those shard files _at the same = point in time_ can be a challenge, but is technically the sort of thing = that=E2=80=99s required to get to the same consistency semantics as the = file-based backup option in v1. If you copy the files at different = points in time the restored database won't correspond to a snapshot of = the database at any particular point in time. Using a snapshotting filesystem (LVM, ZFS, etc.) and copying the = _snapshot_ of the shards directory to a different host is something = worth considering here. Cheers, Adam > On Dec 8, 2016, at 5:23 AM, Reddy B. wrote: >=20 > Hi all, >=20 > The ability to backup as easily as by copying a file was really useful = in version 1 as it allowed us to take advantage of a large array of = general purpose backup tools. >=20 > In 2.x, is it safe to just copy the "shards" folder assuming that we = intend to "restore" it on a cluster having the same configuration ?