Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 4502E200BCE for ; Fri, 18 Nov 2016 00:07:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 4369B160B0B; Thu, 17 Nov 2016 23:07:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B1AC4160B18 for ; Fri, 18 Nov 2016 00:06:59 +0100 (CET) Received: (qmail 27854 invoked by uid 500); 17 Nov 2016 23:06:58 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 27757 invoked by uid 99); 17 Nov 2016 23:06:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Nov 2016 23:06:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 57E2A2C4C72 for ; Thu, 17 Nov 2016 23:06:58 +0000 (UTC) Date: Thu, 17 Nov 2016 23:06:58 +0000 (UTC) From: "Chen Liang (JIRA)" To: hdfs-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HDFS-11154) Block Storage : store server state to persistent storage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 17 Nov 2016 23:07:00 -0000 Chen Liang created HDFS-11154: --------------------------------- Summary: Block Storage : store server state to persistent storage Key: HDFS-11154 URL: https://issues.apache.org/jira/browse/HDFS-11154 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Chen Liang Assignee: Chen Liang Currently, all the storage state are kept in server memory. If server crashes, we would lose all the volume information. This JIRA stores server internal state into its local disk. Such that on server failure, we can simply restart server and restore volume information from disk. More specifically, the internal state written to disk is mainly the mapping from volume to its underlying containers, plus some meta information such as volume size, block size, etc. Note that this is only a simple, minimum set mechanism for persistence. It is more like a counterpart of fsimage in HDFS, but without edit logs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org