impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-trunk) Headers and reservation logic for daemon-wide buffer pool
Date Thu, 12 May 2016 18:03:19 GMT
Tim Armstrong has uploaded a new patch set (#11).

Change subject: Headers and reservation logic for daemon-wide buffer pool
......................................................................

Headers and reservation logic for daemon-wide buffer pool

This patch implements the core interface and reservation bookkeeping
logic for the daemon-wide buffer pool. It is far from fully functional
but is capable of tracking reservations and allocating buffers based
on those reservations. It is not yet integrated at all with the
rest of Impalad.

Includes new reservation mechanism where reservations are always
guaranteed and buffers can't be pinned without a reservation.
Reservations are tracked via a hierarchy of ReservationTrackers.

Locks are fine-grained so that the buffer pool can scale to many
concurrent queries.

Includes basic tests for buffer pool setup, allocation and reservations.

Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6
---
M be/CMakeLists.txt
A be/src/bufferpool/CMakeLists.txt
A be/src/bufferpool/buffer-allocator.cc
A be/src/bufferpool/buffer-allocator.h
A be/src/bufferpool/buffer-pool-test.cc
A be/src/bufferpool/buffer-pool.cc
A be/src/bufferpool/buffer-pool.h
A be/src/bufferpool/reservation-tracker.cc
A be/src/bufferpool/reservation-tracker.h
M be/src/util/internal-queue.h
M common/thrift/generate_error_codes.py
11 files changed, 1,642 insertions(+), 1 deletion(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/69/2569/11
-- 
To view, visit http://gerrit.cloudera.org:8080/2569
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I35cc89e863efb4cc506657bfdaaaf633a10bbab6
Gerrit-PatchSet: 11
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <tarmstrong@cloudera.com>
Gerrit-Reviewer: Dan Hecht <dhecht@cloudera.com>
Gerrit-Reviewer: Marcel Kornacker <marcel@cloudera.com>
Gerrit-Reviewer: Michael Ho
Gerrit-Reviewer: Tim Armstrong <tarmstrong@cloudera.com>

Mime
View raw message