Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A522B17202 for ; Wed, 1 Oct 2014 16:14:39 +0000 (UTC) Received: (qmail 21005 invoked by uid 500); 1 Oct 2014 16:14:39 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 20951 invoked by uid 500); 1 Oct 2014 16:14:39 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 20934 invoked by uid 99); 1 Oct 2014 16:14:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Oct 2014 16:14:39 +0000 Date: Wed, 1 Oct 2014 16:14:39 +0000 (UTC) From: "Lei (Eddy) Xu (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-5952) Create a tool to run data analysis on the PB format fsimage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155000#comment-14155000 ] Lei (Eddy) Xu commented on HDFS-5952: ------------------------------------- Hi, [~haoch]. Thank you very much for your work. Bringing back supports of OIV delimited processor will be very helpful. I just have a few small questions. Are you going to make it into trunk? Moreover, have you tried to process large fsimage (e.g., 16gb). Would you mind to share us the results? It would be appreciated to have this functionality back in trunk. > Create a tool to run data analysis on the PB format fsimage > ----------------------------------------------------------- > > Key: HDFS-5952 > URL: https://issues.apache.org/jira/browse/HDFS-5952 > Project: Hadoop HDFS > Issue Type: Improvement > Components: tools > Affects Versions: 2.6.0 > Reporter: Akira AJISAKA > Attachments: HDFS-5952.patch > > > Delimited processor in OfflineImageViewer is not supported after HDFS-5698 was merged. > The motivation of delimited processor is to run data analysis on the fsimage, therefore, there might be more values to create a tool for Hive or Pig that reads the PB format fsimage directly. -- This message was sent by Atlassian JIRA (v6.3.4#6332)