hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2863) Support web-services for RM & NM
Date Fri, 11 Nov 2011 20:22:52 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148712#comment-13148712
] 

Thomas Graves commented on MAPREDUCE-2863:
------------------------------------------

I updated the rest apis slightly.  Here are the interfaces and will attach output formats
separately in a little while.  Anyone interested in these please review and comment.

Resource Manager:
http://host:8088/ws/v1/cluster/info
http://host:8088/ws/v1/cluster/nodes -> query params: state(String of RMNodeState) and
healthy(boolean)
http://host:8088/ws/v1/cluster/nodes/{nodeAddress} -> nodeAddress is host:port format
http://host:8088/ws/v1/cluster/metrics
http://host:8088/ws/v1/cluster/metrics/{user}
http://host:8088/ws/v1/cluster/scheduler
http://host:8088/ws/v1/cluster/apps/{appid} 
http://host:8088/ws/v1/cluster/apps -> query params: state(String of RMAppState), user(String),
queue(String), limit(int of number to return), startTimeBegin(ms since epoch), startTimeEnd(ms
since epoch), finishTimeBegin(ms since epoch), finishTimeEnd(ms since epoch)


Node Manager:
http://host:9999/ws/v1/nodes/info
http://host:9999/ws/v1/nodes/apps ->  query params: state(String of ApplicationState),
user(String)
http://host:9999/ws/v1/nodes/apps/{appid}
http://host:9999/ws/v1/nodes/containers
http://host:9999/ws/v1/nodes/containers/{containerid}


mapreduce Application Master - these go through the proxy just like web ui
http://host:8088/proxy/{appid}/ws/v1/mapreduce/info
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/counters/{group}/{counterName}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/counters/{group}/{counterName}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/conf
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks -> query params: type(m
or r)
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}

History Server:
http://host:19888/ws/v1/history/info
http://host:19888/ws/v1/history/mapreduce/jobs -> query params: user(String), limit(int
of # to return),  startTimeBegin(ms since epoch), startTimeEnd(ms since epoch), finishTimeBegin(ms
since epoch), finishTimeEnd(ms since epoch), queue(String)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/counters/{group}/{counterName}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/counters/{group}/{counterName}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/conf
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks ->  query params: type(m or
r)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}


For reference:
public enum ApplicationState {
  NEW, INITING, RUNNING, FINISHING_CONTAINERS_WAIT, APPLICATION_RESOURCES_CLEANINGUP, FINISHED

}

public enum RMNodeState {
  RUNNING, UNHEALTHY, DECOMMISSIONED, LOST
}

public enum RMAppState {
  NEW, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED
}


                
> Support web-services for RM & NM
> --------------------------------
>
>                 Key: MAPREDUCE-2863
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2863
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2, nodemanager, resourcemanager
>            Reporter: Arun C Murthy
>            Assignee: Thomas Graves
>         Attachments: MAPREDUCE-2863.patch
>
>
> It will be very useful for RM and NM to support web-services to export json/xml.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message