From user-return-12569-archive-asf-public=cust-asf.ponee.io@zookeeper.apache.org Wed Jan 22 19:18:23 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6B1EE18064C for ; Wed, 22 Jan 2020 20:18:23 +0100 (CET) Received: (qmail 50775 invoked by uid 500); 22 Jan 2020 19:18:22 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 50763 invoked by uid 99); 22 Jan 2020 19:18:21 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jan 2020 19:18:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 6100CC028F for ; Wed, 22 Jan 2020 19:18:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.004 X-Spam-Level: X-Spam-Status: No, score=0.004 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, NUMERIC_HTTP_ADDR=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Tf0nEDYq6AUz for ; Wed, 22 Jan 2020 19:18:19 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.160.169; helo=mail-qt1-f169.google.com; envelope-from=rammohanganap@gmail.com; receiver= Received: from mail-qt1-f169.google.com (mail-qt1-f169.google.com [209.85.160.169]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id A98E5BC90C for ; Wed, 22 Jan 2020 19:18:19 +0000 (UTC) Received: by mail-qt1-f169.google.com with SMTP id w8so435803qts.11 for ; Wed, 22 Jan 2020 11:18:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=vrcAV50sybfN6pgm/FRCXYZMcnp3weSir0T40DwittI=; b=ctYQszZWrd4C3WiZIDaoU+P2bTT/I1RAlsFpkXCPnKqcJDbMx25dsuDJP/F34WQtVQ rqByBXcbvzsiLLAr2oDy00kQf1OUyIv/Q01lnBySjcUXn9iXdEThLrgb6RezjVnbjWfl mi81j8nM0GgOAigvuVIu/hLTBR8BZUU0Wp4vWcosEadvTPVZGhRUuDjafKO6Fa8SYpsy w1nhaE32BPrvvk5mK0Fu+ruQF2G0QZTnUSV+kjRlyPKk+X3ZjMW2ZKy7QyV7P/hnm9V1 rklyO5WiD2WWwA1Tx9l8gU+bNoQUN78gWERvYA1V1I+4e+oAo42xSPb+6xDMGMGrRRGx 1+mw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=vrcAV50sybfN6pgm/FRCXYZMcnp3weSir0T40DwittI=; b=UovCIWHkrUsue5SHvipmGX5wvPAagkG2UrC7Amr10vp3k0Zt8GVsMm+UqPdZDHhtns Yed7tbDa4glCSBG3TbcIpfyrxfB9QHgp7hYg1O4oaL2jBOTA64yk02mygPuhO+Xr4LGE Y2DrHmpS3y0DH3a7AKg0FHz1sQCTuev3RpURsQ2r2h64ybzrv8mnqgHlRky7JW5Z7FzW Gu0Sn8SiY1LZu0HiLd8C90FRzGlYqVCERgDiMBvZsIh+sUHz3Dg1Lb1Vy0hXnrffVJ/w 4KZoI6bfYA49tGVS0JxfKI2U5Y5ArmnSSuCHchU98SZ1hOsCsNEkpYd5Reuje0U/j80h bGlw== X-Gm-Message-State: APjAAAUlgb9FCP4MVDUPPgiXMWyBn4o9q4IFe0/A75SF60QITosHH4Nn 2LfU58X8Yi/Y/REKflWXeyhWXGQeU1h0QTQsazAzs0esM/c= X-Google-Smtp-Source: APXvYqyhAel2vGGx8msxKhU+2Q1jGi5GUcYqBc/NgA8KNa5yUFDyYAOm2yI94Km++bzA+dQb/70OOictjAavLByrxqI= X-Received: by 2002:ac8:7188:: with SMTP id w8mr11865722qto.139.1579720692901; Wed, 22 Jan 2020 11:18:12 -0800 (PST) MIME-Version: 1.0 From: rammohan ganapavarapu Date: Wed, 22 Jan 2020 11:17:36 -0800 Message-ID: Subject: Reading snapshot To: user@zookeeper.apache.org Content-Type: multipart/alternative; boundary="000000000000beaa5e059cbf62d3" --000000000000beaa5e059cbf62d3 Content-Type: text/plain; charset="UTF-8" Hi, What is the purpose of reading snapshot from disk while zk processes starting up? i have a snapshot of ~2gb and it is taking time to read that snapshot, hence cluster recovery time. Is it to get the last zxid of that server? ```2020-01-21 23:11:24,510 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:QuorumPeer@967] - OBSERVING 2020-01-21 23:11:24,510 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@174] - Created server with tickTime 60000 minSessionTimeout 120000 maxSessionTimeout 1200000 datadir /opt/data/zookeeper/logs/version-2 snapdir /opt/data/zookeeper/data/version-2 2020-01-21 23:11:24,510 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:ObserverZooKeeperServer@64] - syncEnabled =true 2020-01-21 23:11:24,511 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:QuorumPeer$QuorumServer@185] - Resolved hostname: rzk100ea to address: rzk100ea/192.168.10.78 2020-01-21 23:11:24,512 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:Observer@65] - Observing rzk100ea/192.168.10.78:2888 2020-01-21 23:11:24,711 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:FileSnap@86] - Reading snapshot /opt/data/zookeeper/data/version-2/snapshot.5a00000000 2020-01-21 23:12:31,954 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:Learner@336] - Getting a snapshot from leader 0x5b00000000 2020-01-21 23:18:32,497 [myid:106] - INFO [QuorumPeer[myid=106]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@301] - Snapshotting: 0x5b00000000 to /opt/data/zookeeper/data/version-2/snapshot.5b00000000``` Thanks, Ram --000000000000beaa5e059cbf62d3--