hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6244) Improvements to FileContext metrics output formatting
Date Thu, 05 Nov 2009 00:35:32 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12773727#action_12773727

Chris Douglas commented on HADOOP-6244:

bq. this is why I left the old format in as a configuration option. Is anyone actually using
the old format, though? [...] I think now (ie before 1.0) is the time when we should feel
free to change formats/APIs that are clearly bad as long as we provide a deprecated compatibility
path, yes?

FileContext has been around for a long time, and while I agree that pre-1.0 is a great time
for format and API changes, we're not indifferent to compatibility. The metrics framework
has plenty of known awkwardnesses; if it's going to change incompatibly, addressing more than
missing timestamps would make sense.

bq. JSON would be reasonable, but I think it's important we continue to have a simpler text
metrics logging option. When fishing around on nodes it's good to be able to use perl, grep,
and awk without having to install a JSON parser. Avro makes sense for those who want to do
long term analysis, but I think that should be a separate patch.

I agree that writing metrics in a templated/standard format should be in a separate issue.
I mentioned it to qualify and mostly retract the request for a reader.

> Improvements to FileContext metrics output formatting
> -----------------------------------------------------
>                 Key: HADOOP-6244
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6244
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: metrics
>    Affects Versions: 0.22.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.22.0
>         Attachments: hadoop-6244.txt
> The output of FileContext has two big issues: 1) it doesn't include a timestamp, 2) it
doesn't differentiate between tags and metrics in formatting. This patch is to improve the
output format to be more useful.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message