drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4146) Concurrent queries hang in planner in ReflectiveRelMetadataProvider
Date Tue, 01 Dec 2015 01:50:11 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032876#comment-15032876

ASF GitHub Bot commented on DRILL-4146:

GitHub user amansinha100 opened a pull request:


    DRILL-4146: Concurrent queries hang in planner.  Fix is in Calcite (C…


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/amansinha100/incubator-drill hashfunc2

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #285
commit 39a11b8ae1e103b9a1e9c141918023ead5361e46
Author: Aman Sinha <asinha@maprtech.com>
Date:   2015-12-01T01:48:46Z

    DRILL-4146: Concurrent queries hang in planner.  Fix is in Calcite (CALCITE-874).


> Concurrent queries hang in planner in ReflectiveRelMetadataProvider
> -------------------------------------------------------------------
>                 Key: DRILL-4146
>                 URL: https://issues.apache.org/jira/browse/DRILL-4146
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 1.3.0
>            Reporter: Aman Sinha
>            Assignee: Aman Sinha
>             Fix For: 1.4.0
> At concurrency levels of 30 or more for certain workloads we have seen queries hang in
the planning phase in Calcite.  The top of the jstack is shown below: 
> {noformat}
> "29b47a17-6ef3-4b7f-98e7-a7c1a702c32f:foreman" daemon prio=10 tid=0x00007f55484a1800
nid=0x289a runnable [0x00007f54b4369000]
>    java.lang.Thread.State: RUNNABLE
>         at java.util.HashMap.getEntry(HashMap.java:465)
>         at java.util.HashMap.get(HashMap.java:417)
>         at org.apache.calcite.rel.metadata.ReflectiveRelMetadataProvider.apply(ReflectiveRelMetadataProvider.java:251)
>         at org.apache.calcite.rel.metadata.ChainedRelMetadataProvider.apply(ChainedRelMetadataProvider.java:60)
>         at org.apache.calcite.rel.metadata.ChainedRelMetadataProvider.apply(ChainedRelMetadataProvider.java:60)
> {noformat}
> After some investigations, we found that this issue was actually addressed by CALCITE-874
(ReflectiveRelMetadataProvider is not thread-safe).   This JIRA is a placeholder to merge
that Calcite fix since Drill is currently not up-to-date with Calcite and there is an immediate
need for running queries in a high concurrency environment. 

This message was sent by Atlassian JIRA

View raw message