drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-2722) Query profile data not being sent/received (and web UI not updated)
Date Wed, 08 Apr 2015 20:03:13 GMT

     [ https://issues.apache.org/jira/browse/DRILL-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aman Sinha updated DRILL-2722:
------------------------------
    Attachment: query1_foreman.log

The query I ran is a 3 table join on a large 30TB TPC-DS data: 
 {code}
 0: jdbc:drill:schema=dfs.tpcds> select count(*) from store_sales_dri30000 ss, item_dri30000
i, store_returns_dri30000 sr  where ss.ss_item_sk = i.i_item_sk and sr.sr_item_sk = i.i_item_sk;
 {code}

Attached is the last portion of the drillbit log on the foreman node.  Note that the profile
updates were being received by the QueryManager on the foreman node until 07:59 am.  After
that no more updates were received but the query was still running until I canceled.  There
were no exceptions or failures in the logs on all the nodes.   I also have the jstack dump
for all the DrillBit processes in case needed.  

> Query profile data not being sent/received (and web UI not updated)
> -------------------------------------------------------------------
>
>                 Key: DRILL-2722
>                 URL: https://issues.apache.org/jira/browse/DRILL-2722
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Client - HTTP, Execution - Flow, Execution - RPC
>    Affects Versions: 0.8.0
>            Reporter: Chris Westin
>            Assignee: Sudheesh Katkam
>             Fix For: 0.9.0
>
>         Attachments: query1_foreman.log
>
>
> [~amansinha100] has a test case that shows that profile information is not being received
(or not being sent, I'm not sure which) for a long-running query. The query appears to stop,
even though cycles are being used, and it looks like work is being done. This is becoming
a problem for monitoring query progress. We need to find out why the profile information isn't
being updated, and fix that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message