hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text
Date Tue, 02 Jul 2013 23:57:21 GMT

    [ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698415#comment-13698415
] 

Zhijie Shen commented on YARN-649:
----------------------------------

Read the patch quickly. It looks almost fine to me. One minor question: why does getLogs not
support XML?

{code}
+  @GET
+  @Path("/containerlogs/{containerid}/{filename}")
+  @Produces({ MediaType.TEXT_PLAIN, MediaType.APPLICATION_JSON })
+  @Evolving
+  public Response getLogs(@PathParam("containerid") String containerIdStr,
+      @PathParam("filename") String filename) {
{code}

Here's some additional thoughts. For the long running applications, they may have a big log
file, such that it will take a long time to download the log file via the RESTful API. Consequently,
HTTP connection may timeout before downloading before downloading a complete log file. Maybe
it is good to zip the log file before sending it, and unzip it after receiving it. Moreover,
it can be more advanced to query the part of log which is recorded during timestamp1 and timestamp2.
Just think out loudly. Not sure it is required right now.
                
> Make container logs available over HTTP in plain text
> -----------------------------------------------------
>
>                 Key: YARN-649
>                 URL: https://issues.apache.org/jira/browse/YARN-649
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.0.4-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: YARN-649-2.patch, YARN-649-3.patch, YARN-649-4.patch, YARN-649.patch,
YARN-752-1.patch
>
>
> It would be good to make container logs available over the REST API for MAPREDUCE-4362
and so that they can be accessed programatically in general.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message