hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3971) Job History web services need to have limits on the number of itmes they can return.
Date Mon, 12 Mar 2012 16:13:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227643#comment-13227643
] 

Robert Joseph Evans commented on MAPREDUCE-3971:
------------------------------------------------

Bhallamudi,

I agree that there are a number of optimizations that can be made and that we can guarantee
ordering if we do them correctly. I am just not positive what those optimizations should be
yet.  I made a proposal on MAPREDUCE-3973 to possibly change the back end all together.  If
you have feedback on it I would be very grateful to hear it.  Depending on how that proposal
is received the way this JIRA is implemented could be very different. 
                
> Job History web services need to have limits on the number of itmes they can return.
> ------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3971
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3971
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Robert Joseph Evans
>
> The Job History web services canput a very large load on the job history server.  We
should put in a limit on the number of entries that can be returned by the web service, and
also add in the ability to modify the starting location in the list, so that all entries can
still be downlaoded.  Just not all at once.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message