hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vrushali C (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5627) [Atsv2] Support streaming reader API to fetch entities
Date Tue, 13 Mar 2018 01:39:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396371#comment-16396371
] 

Vrushali C commented on YARN-5627:
----------------------------------

Do you mean pagination? 

Pagination could mean return max N entities at a time or max N bytes of entities at a time.
 Also, I cant recollect if we already do, but we should support filters in entities. For example,
not all fields in entities may be relevant to a user. We should allow retrieving only some
fields. 


> [Atsv2] Support streaming reader API to fetch entities
> ------------------------------------------------------
>
>                 Key: YARN-5627
>                 URL: https://issues.apache.org/jira/browse/YARN-5627
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelinereader
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Major
>
> There is no limit for size of TimelineEntitie object. It can be varied from KB's to MB.
While reading entities list, it would be an potential issue that TimeLineReder would go into
OOM situation based on the entity size and limit. 
> Proposal is to support an streaming API to read entities list. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message