drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abdel Hakim Deneche <adene...@maprtech.com>
Subject connection allocator in rpc layer is using too much memory
Date Tue, 07 Jul 2015 16:13:41 GMT
Trying to investigate DRILL-3241
<https://issues.apache.org/jira/browse/DRILL-3241> (query hangs if out of
memory in RPC layer), I see the following warning in the logs:

WARN: Failure allocating buffer on incoming stream due to

 memory limits.  Current Allocation: 1372678764.

This happening in ProtobufLengthDecoder.decode() on the receiver side (data

Is it expected for the connection allocation to allocation > 1GB of memory
? shouldn't the allocated batches be transferred to the receiving
fragment's allocator ?



Abdelhakim Deneche

Software Engineer


Now Available - Free Hadoop On-Demand Training

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message