hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Lu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation
Date Tue, 28 Apr 2015 23:40:08 GMT

    [ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518360#comment-14518360
] 

Li Lu commented on YARN-3551:
-----------------------------

Hi [~sjlee0]! I agree it would be nice to have more strict type enforcement with templates,
but right now I'm not very clear about how this would impact the writer/reader implementation.
Upon storage, how can we choose the right serialization method for the type? Meanwhile, to
reconstruct the data in readers, maybe we need to store metadata about the type information
for each metric object? 

> Consolidate data model change according to the backend implementation
> ---------------------------------------------------------------------
>
>                 Key: YARN-3551
>                 URL: https://issues.apache.org/jira/browse/YARN-3551
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: YARN-3551.1.patch, YARN-3551.2.patch, YARN-3551.3.patch
>
>
> Based on the comments on [YARN-3134|https://issues.apache.org/jira/browse/YARN-3134?focusedCommentId=14512080&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14512080]
and [YARN-3411|https://issues.apache.org/jira/browse/YARN-3411?focusedCommentId=14512098&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14512098],
we need to change the data model to restrict the data type of info/config/metric section.
> 1. Info: the value could be all kinds object that is able to be serialized/deserialized
by jackson.
> 2. Config: the value will always be assumed as String.
> 3. Metric: single data or time series value have to be number for aggregation.
> Other than that, info/start time/finish time of metric seem not to be necessary for storage.
They should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message