falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Trupti Dhavle (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-1986) logFile retrieved when getting process instance status should be a link that points to logs
Date Thu, 26 May 2016 17:09:13 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Trupti Dhavle updated FALCON-1986:
----------------------------------
    Description: 
We are noticing that the value for logFile paramter is no longer a link to the logs. Instead
it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned there
were changes around rerun that caused this. However I think the paramter should point to a
link that opens the logs for the said action (workflow) instead of just a value thats not
even a link
Output from the command-

{noformat}
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user>
(BaseRequest:175)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Method: GET (BaseRequest:176)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY="
(BaseRequest:179)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Status: HTTP/1.1 200 OK (BaseRequest:207)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Content-Type Value=application/json (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ The
web service response is:
{
  "status": "SUCCEEDED",
  "message": "default/STATUS\n",
  "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
  "instances": [
    {
      "instance": "2010-01-02T01:20Z",
      "status": "RUNNING",
      "logFile": "0001137-160524002538450-oozie-oozi-C@5",
      "cluster": "A33ffd6c8-9b45ca54",
      "startTime": "2016-05-24T05:05:26Z",
      "runId": 0,
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
        }
      ]
    },

{noformat}

Prior releases it was returning as below-
{noformat}
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user>
(BaseRequest:168)
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Method: GET (BaseRequest:169)
2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg="
(BaseRequest:172)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Status: HTTP/1.1 200 OK (BaseRequest:201)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Content-Type Value=application/json (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ The
web service response is:
{
    {
      "instance": "2010-01-02T01:05Z",
      "status": "RUNNING",
      "logFile": "http://<host>:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
      "cluster": "A33ffd6c8-4482f810",
      "startTime": "2016-05-25T02:03:34Z",
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
        }
      ]
    },
{noformat}

  was:
We are noticing that the value for logFile paramter is no longer a link to the logs. Instead
it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned there
were changes around rerun that caused this. However I think the paramter should point to a
link that opens the logs for the said action (workflow) instead of just a value thats not
even a link
Output from the command-

{noformat}
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user>
(BaseRequest:175)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Method: GET (BaseRequest:176)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request
Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY="
(BaseRequest:179)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Status: HTTP/1.1 200 OK (BaseRequest:207)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Content-Type Value=application/json (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ The
web service response is:
{
  "status": "SUCCEEDED",
  "message": "default/STATUS\n",
  "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
  "instances": [
    {
      "instance": "2010-01-02T01:20Z",
      "status": "RUNNING",
      "logFile": "0001137-160524002538450-oozie-oozi-C@5",
      "cluster": "A33ffd6c8-9b45ca54",
      "startTime": "2016-05-24T05:05:26Z",
      "runId": 0,
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
        }
      ]
    },

{noformat}

Prior releases it was returning as below-
{noformat}
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user>
(BaseRequest:168)
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Method: GET (BaseRequest:169)
2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request
Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg="
(BaseRequest:172)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Status: HTTP/1.1 200 OK (BaseRequest:201)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Content-Type Value=application/json (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response
Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ The
web service response is:
{
    {
      "instance": "2010-01-02T01:05Z",
      "status": "RUNNING",
      "logFile": "http://os-r6-hnphvs-falcon-1-13.openstacklocal:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
      "cluster": "A33ffd6c8-4482f810",
      "startTime": "2016-05-25T02:03:34Z",
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
        }
      ]
    },
{noformat}


> logFile retrieved when getting process instance status should be a link that points to
logs
> -------------------------------------------------------------------------------------------
>
>                 Key: FALCON-1986
>                 URL: https://issues.apache.org/jira/browse/FALCON-1986
>             Project: Falcon
>          Issue Type: Bug
>          Components: process
>    Affects Versions: 0.9
>            Reporter: Trupti Dhavle
>
> We are noticing that the value for logFile paramter is no longer a link to the logs.
Instead it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned
there were changes around rerun that caused this. However I think the paramter should point
to a link that opens the logs for the said action (workflow) instead of just a value thats
not even a link
> Output from the command-
> {noformat}
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Request Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user>
(BaseRequest:175)
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Request Method: GET (BaseRequest:176)
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY="
(BaseRequest:179)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
> 2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams]
~ The web service response is:
> {
>   "status": "SUCCEEDED",
>   "message": "default/STATUS\n",
>   "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
>   "instances": [
>     {
>       "instance": "2010-01-02T01:20Z",
>       "status": "RUNNING",
>       "logFile": "0001137-160524002538450-oozie-oozi-C@5",
>       "cluster": "A33ffd6c8-9b45ca54",
>       "startTime": "2016-05-24T05:05:26Z",
>       "runId": 0,
>       "details": "",
>       "actions": [
>         {
>           "action": "aggregator",
>           "status": "RUNNING",
>           "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
>         }
>       ]
>     },
> {noformat}
> Prior releases it was returning as below-
> {noformat}
> 2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Request Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user>
(BaseRequest:168)
> 2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Request Method: GET (BaseRequest:169)
> 2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg="
(BaseRequest:172)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Response Status: HTTP/1.1 200 OK (BaseRequest:201)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Content-Type Value=application/json (BaseRequest:203)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
> 2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams]
~ The web service response is:
> {
>     {
>       "instance": "2010-01-02T01:05Z",
>       "status": "RUNNING",
>       "logFile": "http://<host>:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
>       "cluster": "A33ffd6c8-4482f810",
>       "startTime": "2016-05-25T02:03:34Z",
>       "details": "",
>       "actions": [
>         {
>           "action": "aggregator",
>           "status": "RUNNING",
>           "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
>         }
>       ]
>     },
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message