ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nishant Bangarwa (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AMBARI-22191) Druid stack advisor for memory does not account number of merge buffers while calculating processing buffer size
Date Tue, 10 Oct 2017 17:05:00 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nishant Bangarwa updated AMBARI-22191:
--------------------------------------
    Attachment: AMBARI-22191.patch

> Druid stack advisor for memory does not account number of merge buffers while calculating
processing buffer size
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-22191
>                 URL: https://issues.apache.org/jira/browse/AMBARI-22191
>             Project: Ambari
>          Issue Type: Bug
>            Reporter: Nishant Bangarwa
>            Assignee: Nishant Bangarwa
>            Priority: Critical
>             Fix For: trunk, 2.6.0
>
>         Attachments: AMBARI-22191.patch
>
>
> This is leading to OOME with default configs on a 16 core machine with 16G of ram. 
> {code} 
> 5) Error in custom provider, java.lang.OutOfMemoryError
>   at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
(via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule
-> io.druid.guice.DruidProcessingModule)
>   at io.druid.guice.DruidProcessingModule.getMergeBufferPool(DruidProcessingModule.java:124)
(via modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule
-> io.druid.guice.DruidProcessingModule)
>   while locating io.druid.collections.BlockingPool<java.nio.ByteBuffer> annotated
with @io.druid.guice.annotations.Merging()
>     for the 4th parameter of io.druid.query.groupby.strategy.GroupByStrategyV2.<init>(GroupByStrategyV2.java:97)
>   while locating io.druid.query.groupby.strategy.GroupByStrategyV2
>     for the 3rd parameter of io.druid.query.groupby.strategy.GroupByStrategySelector.<init>(GroupByStrategySelector.java:43)
>   while locating io.druid.query.groupby.strategy.GroupByStrategySelector
>     for the 1st parameter of io.druid.query.groupby.GroupByQueryQueryToolChest.<init>(GroupByQueryQueryToolChest.java:104)
>   at io.druid.guice.QueryToolChestModule.configure(QueryToolChestModule.java:95) (via
modules: com.google.inject.util.Modules$OverrideModule -> com.google.inject.util.Modules$OverrideModule
-> io.druid.guice.QueryRunnerFactoryModule)
>   while locating io.druid.query.groupby.GroupByQueryQueryToolChest
>   while locating io.druid.query.QueryToolChest annotated with @com.google.inject.multibindings.Element(setNa
> {code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message