impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-trunk) PREVIEW: Use mmap instead of malloc for buffer pool
Date Thu, 12 May 2016 18:03:38 GMT
Tim Armstrong has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/3046

Change subject: PREVIEW: Use mmap instead of malloc for buffer pool
......................................................................

PREVIEW: Use mmap instead of malloc for buffer pool

Allocate with mmap instead of TCMalloc to give more control over memory
usage. Also allocate huge pages when possible to reduce TLB pressure.

We also need some additional memory metrics, since we previously relied
on the assumption that all memory was allocated through TCMalloc.

Change-Id: Ifbc748f74adcbbdcfa45f3ec7df98284925acbd6
---
M be/src/bufferpool/CMakeLists.txt
A be/src/bufferpool/buffer-allocator-test.cc
M be/src/bufferpool/buffer-allocator.cc
M be/src/bufferpool/buffer-allocator.h
M be/src/bufferpool/buffer-pool.h
M be/src/catalog/catalogd-main.cc
M be/src/runtime/exec-env.cc
M be/src/statestore/statestored-main.cc
M be/src/util/memory-metrics.cc
M be/src/util/memory-metrics.h
M be/src/util/metrics-test.cc
M be/src/util/metrics.h
M common/thrift/generate_error_codes.py
M common/thrift/metrics.json
14 files changed, 335 insertions(+), 14 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/46/3046/1
-- 
To view, visit http://gerrit.cloudera.org:8080/3046
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: Ifbc748f74adcbbdcfa45f3ec7df98284925acbd6
Gerrit-PatchSet: 1
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <tarmstrong@cloudera.com>

Mime
View raw message