hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vrushali C (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5627) [Atsv2] Support streaming reader API to fetch entities
Date Tue, 13 Mar 2018 01:39:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396371#comment-16396371

Vrushali C commented on YARN-5627:

Do you mean pagination? 

Pagination could mean return max N entities at a time or max N bytes of entities at a time.
 Also, I cant recollect if we already do, but we should support filters in entities. For example,
not all fields in entities may be relevant to a user. We should allow retrieving only some

> [Atsv2] Support streaming reader API to fetch entities
> ------------------------------------------------------
>                 Key: YARN-5627
>                 URL: https://issues.apache.org/jira/browse/YARN-5627
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelinereader
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Major
> There is no limit for size of TimelineEntitie object. It can be varied from KB's to MB.
While reading entities list, it would be an potential issue that TimeLineReder would go into
OOM situation based on the entity size and limit. 
> Proposal is to support an streaming API to read entities list. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message