hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2863) Support web-services for RM & NM
Date Mon, 28 Nov 2011 16:21:41 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158532#comment-13158532
] 

Thomas Graves commented on MAPREDUCE-2863:
------------------------------------------

Here is api and output format with the patch I'm about to upload.  I would propose to have
this reviewed/committed and do the few remaining things as separate follow on jiras. 

Remaining issues I will file Jiras for: 
 - have proxy handle auto redirect of webservice calls
 - add more unit tests
 - add api documentation

resource manager apis:
http://host:8088/ws/v1/cluster/info
http://host:8088/ws/v1/cluster/nodes -> query params: state(String of RMNodeState) and
healthy(boolean)
http://host:8088/ws/v1/cluster/nodes/{nodeId} -> nodeId is host:port format
http://host:8088/ws/v1/cluster/metrics
http://host:8088/ws/v1/cluster/scheduler
http://host:8088/ws/v1/cluster/apps/{appid}
http://host:8088/ws/v1/cluster/apps -> query params: state(String of RMAppState), user(String),
queue(String), limit(int of number to return), startTimeBegin(ms since epoch), startTimeEnd(ms
since epoch), finishTimeBegin(ms since epoch), finishTimeEnd(ms since epoch)

Node manager apis:
http://host:9999/ws/v1/nodes/info
http://host:9999/ws/v1/nodes/apps -> query params: state(String of ApplicationState), user(String)
http://host:9999/ws/v1/nodes/apps/{appid}
http://host:9999/ws/v1/nodes/containers
http://host:9999/ws/v1/nodes/containers/{containerid}

mapreduce application master:
http://host:8088/proxy/{appid}/ws/v1/mapreduce/info
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/conf
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks -> query params: type(m
or r)
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}/counters

History server apis:
http://host:19888/ws/v1/history/info
http://host:19888/ws/v1/history/mapreduce/jobs -> query params: user(String), limit(int
of # to return), startTimeBegin(ms since epoch), startTimeEnd(ms since epoch), finishTimeBegin(ms
since epoch), finishTimeEnd(ms since epoch), queue(String)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/attempts
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/conf
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks -> query params: type(m or
r)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}/counters

                
> Support web-services for RM & NM
> --------------------------------
>
>                 Key: MAPREDUCE-2863
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2863
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2, nodemanager, resourcemanager
>    Affects Versions: 0.23.0
>            Reporter: Arun C Murthy
>            Assignee: Thomas Graves
>            Priority: Blocker
>         Attachments: MAPREDUCE-2863.patch, amoutput.txt, nmoutput.txt, nmoutput.txt,
rmoutput.txt, rmoutput.txt
>
>
> It will be very useful for RM and NM to support web-services to export json/xml.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message