Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BA713200BEB for ; Wed, 23 Nov 2016 02:53:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B92DF160B1C; Wed, 23 Nov 2016 01:53:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1529B160B0C for ; Wed, 23 Nov 2016 02:52:59 +0100 (CET) Received: (qmail 7767 invoked by uid 500); 23 Nov 2016 01:52:59 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 7740 invoked by uid 99); 23 Nov 2016 01:52:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Nov 2016 01:52:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 164482C4C73 for ; Wed, 23 Nov 2016 01:52:59 +0000 (UTC) Date: Wed, 23 Nov 2016 01:52:59 +0000 (UTC) From: "Anu Engineer (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-11154) Block Storage : store server state to persistent storage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 23 Nov 2016 01:53:00 -0000 [ https://issues.apache.org/jira/browse/HDFS-11154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11154: -------------------------------- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Version/s: HDFS-7240 Status: Resolved (was: Patch Available) [~vagarychen] Thanks for contributing the patch. I have committed this to the ozone branch. > Block Storage : store server state to persistent storage > -------------------------------------------------------- > > Key: HDFS-11154 > URL: https://issues.apache.org/jira/browse/HDFS-11154 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs > Reporter: Chen Liang > Assignee: Chen Liang > Fix For: HDFS-7240 > > Attachments: HDFS-11154-HDFS-7240.001.patch, HDFS-11154-HDFS-7240.002.patch, HDFS-11154-HDFS-7240.003.patch, HDFS-11154-HDFS-7240.004.patch, HDFS-11154-HDFS-7240.005.patch, HDFS-11154-HDFS-7240.005.patch, HDFS-11154-HDFS-7240.006.patch, HDFS-11154-HDFS-7240.007.patch > > > Currently, all the storage state are kept in server memory. If server crashes, we would lose all the volume information. This JIRA stores server internal state into its local disk. Such that on server failure, we can simply restart server and restore volume information from disk. > More specifically, the internal state written to disk is mainly the mapping from volume to its underlying containers, plus some meta information such as volume size, block size, etc. > Note that this is only a simple, minimum set mechanism for persistence. It is more like a counterpart of fsimage in HDFS, but without edit logs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org