drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5507) Millions of "Failure finding Drillbit running on host" info messages in foreman logs
Date Thu, 17 Aug 2017 23:03:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131455#comment-16131455
] 

ASF GitHub Bot commented on DRILL-5507:
---------------------------------------

Github user ilooner-mapr commented on the issue:

    https://github.com/apache/drill/pull/911
  
    Applied comments


> Millions of "Failure finding Drillbit running on host" info messages in foreman logs
> ------------------------------------------------------------------------------------
>
>                 Key: DRILL-5507
>                 URL: https://issues.apache.org/jira/browse/DRILL-5507
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 1.10.0
>            Reporter: Veera Naranammalpuram
>            Assignee: Timothy Farkas
>
> When foreman tries to execute a query with data files that reside on nodes other than
the nodes that are running drillbits, there are millions of messages in the log files like
this:
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp0535.mydomain.com.  Skipping affinity to
that host.
> After 200 MB of these messages, 960K of them and 7 seconds of planning, it continues
to execute this query. Is there a way to disable / suppress these messages? What's causing
this? Should this be printed with INFO logging as we're seeing or only with DEBUG logging?
Is there a way to turn off this check? Below is a snippet from foreman logs: 
> 2017-05-10 13:22:10,916 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp0535.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp1402.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp0929.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp1098.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp1230.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp1388.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp0535.mydomain.com.  Skipping affinity to
that host.
> 2017-05-10 13:22:10,923 [26eca5b2-a847-b7fe-adff-1685de29bb7a:foreman] INFO  o.a.d.e.s.schedule.BlockMapBuilder
- Failure finding Drillbit running on host hostlp1291.mydomain.com.  Skipping affinity to
that host.
> The hostname and domain are scrubbed. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message