Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B184E17802 for ; Sat, 24 Jan 2015 01:24:38 +0000 (UTC) Received: (qmail 44012 invoked by uid 500); 24 Jan 2015 01:24:37 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 43906 invoked by uid 500); 24 Jan 2015 01:24:37 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 43804 invoked by uid 99); 24 Jan 2015 01:24:37 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 24 Jan 2015 01:24:37 +0000 Date: Sat, 24 Jan 2015 01:24:37 +0000 (UTC) From: "Haohui Mai (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290331#comment-14290331 ] Haohui Mai commented on HDFS-6673: ---------------------------------- bq. Also, even a 40GB image easily fits in memory on server these days. The whole point of this tool is to run the oiv on machines that do not have the luxury of abundant memory. Can you clarify what point you are trying to make? bq. These seem like pretty big drawbacks to me, and are addressed by this tool. I think calling it "half-baked" is unfair considering it provides greater functionality. Can you clarify what the greater functionality are? The Delimiter only outputs mtime/atime and other information available from legacy fsimage. BTW, if you really want to commit this please update the document to explicit state that the tool will not work for large fsimage, so that the users won't be caught by surprise. > Add Delimited format supports for PB OIV tool > --------------------------------------------- > > Key: HDFS-6673 > URL: https://issues.apache.org/jira/browse/HDFS-6673 > Project: Hadoop HDFS > Issue Type: Sub-task > Affects Versions: 2.4.0 > Reporter: Lei (Eddy) Xu > Assignee: Lei (Eddy) Xu > Priority: Minor > Attachments: HDFS-6673.000.patch, HDFS-6673.001.patch, HDFS-6673.002.patch, HDFS-6673.003.patch, HDFS-6673.004.patch, HDFS-6673.005.patch, HDFS-6673.006.patch > > > The new oiv tool, which is designed for Protobuf fsimage, lacks a few features supported in the old {{oiv}} tool. > This task adds supports of _Delimited_ processor to the oiv tool. -- This message was sent by Atlassian JIRA (v6.3.4#6332)