hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jakob Homan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-5467) Create an offline fsimage image viewer
Date Mon, 23 Mar 2009 21:45:51 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jakob Homan updated HADOOP-5467:
--------------------------------

    Attachment: HADOOP-5467.patch

Finished initial version.  Patch ready for review.
{noformat}
     [exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 2 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of
release audit warnings.
{noformat}
Passes all unit tests.

Includes code, unit tests and documentation.  One area where I think my unit tests may be
lacking is fsimages that inodes under construction.  I've manually tested this section using
fsimages I created, but am not sure how to test this as a unit test.  Maybe Konstantin has
an idea?

The final outputs are pretty much the same as described above.  The Ls format is now the default,
and for that format and XML, nothing is printed to the screen unless explicitly turned on
via the -printToScreen command line switch.

Significantly, I've added the ability to read fsimages with layout versions back to -16, which
corresponds to Hadoop 18.  I've tested this against many fsimages here at Yahoo! and all have
worked great.  Image size is not an issue.

> Create an offline fsimage image viewer
> --------------------------------------
>
>                 Key: HADOOP-5467
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5467
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: util
>            Reporter: Jakob Homan
>            Assignee: Jakob Homan
>         Attachments: fsimage.xml, HADOOP-5467.patch, HADOOP-5467.patch
>
>
> It would be useful to have a tool to examine/dump the contents of the fsimage file to
human-readable form.  This would allow analysis of the namespace (file usage, block sizes,
etc) without impacting the operation of the namenode.  XML would be reasonable output format,
as it can be easily viewed, compressed and manipulated via either XSLT or XQuery.  
> I've started work on this and will have an initial version soon.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message