hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei (Eddy) Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5952) Create a tool to run data analysis on the PB format fsimage
Date Wed, 01 Oct 2014 16:14:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14155000#comment-14155000
] 

Lei (Eddy) Xu commented on HDFS-5952:
-------------------------------------

Hi, [~haoch].

Thank you very much for your work. Bringing back supports of OIV delimited processor will
be very helpful. I just have a few small questions.

Are you going to make it into trunk? Moreover, have you tried to process large fsimage (e.g.,
16gb). Would you mind to share us the results?

It would be appreciated to have this functionality back in trunk. 

> Create a tool to run data analysis on the PB format fsimage
> -----------------------------------------------------------
>
>                 Key: HDFS-5952
>                 URL: https://issues.apache.org/jira/browse/HDFS-5952
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: tools
>    Affects Versions: 2.6.0
>            Reporter: Akira AJISAKA
>         Attachments: HDFS-5952.patch
>
>
> Delimited processor in OfflineImageViewer is not supported after HDFS-5698 was merged.
> The motivation of delimited processor is to run data analysis on the fsimage, therefore,
there might be more values to create a tool for Hive or Pig that reads the PB format fsimage
directly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message