impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sailesh Mukil (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-4014: Introduce query-wide execution state.
Date Thu, 25 Aug 2016 00:05:43 GMT
Sailesh Mukil has uploaded a new patch set (#11).

Change subject: IMPALA-4014: Introduce query-wide execution state.

IMPALA-4014: Introduce query-wide execution state.

This patch is a header preview of a query wide execution state for
a backend.

Changes in design are as follows:

FragmentMgr -> QueryExecMgr
  The QueryExecMgr now receives incoming fragments, creates a new
  QueryExecState if it is the first fragment to arrive for that
  query, and passes this received fragment along to the QueryExecState.
  This class is responsible for cleaning up the QueryExecState.

QueryExecState (new):
  This is the query wide state for the backend. It is initialized by
  the first fragment to arrive to the QueryExecMgr. This class is now
  responsible for creating FragmentExecStates and executing them.
  Its life is protected by a ref counting mechanism and it is
  scheduled for destruction once the ref count reaches zero.
  Once scheduled for destruction, a thread in the QueryExecMgr will
  destroy the QueryExecState.
  Every user of the QueryExecState must access it within the scope of
  ScopedQueryExecStateRef which guarantees ref count incrementing and
  decrementing at entry/exit of the scope.

QueryExecState (old) -> ClientRequestExecState:
  This is just a class name change.

  We still do not include shared state into the QueryExecState because
  there needs to be changes to DescriptorTbl, etc. before we can
  incorporate them into the QueryExecState. Will be done as separate

P.S: This only shows what the changes would look like and as of yet
still does not compile.

 - Some class renames in places not important to the core patch logic.
 - Most .cc files to make use of changes made.

Change-Id: I892091d6401acb2ea91ccb1623af54c6f9635e6c
M be/src/runtime/CMakeLists.txt
M be/src/runtime/
M be/src/runtime/coordinator.h
M be/src/runtime/exec-env.h
R be/src/runtime/
R be/src/runtime/fragment-instance-exec-state.h
R be/src/runtime/
R be/src/runtime/fragment-instance-executor.h
A be/src/runtime/
A be/src/runtime/query-exec-state.h
M be/src/runtime/
M be/src/runtime/runtime-state.h
M be/src/service/CMakeLists.txt
R be/src/service/
R be/src/service/client-request-exec-state.h
D be/src/service/
D be/src/service/fragment-mgr.h
M be/src/service/impala-internal-service.h
A be/src/service/
A be/src/service/query-exec-mgr.h
M be/src/util/
M be/src/util/impalad-metrics.h
M common/thrift/ImpalaInternalService.thrift
23 files changed, 779 insertions(+), 385 deletions(-)

  git pull ssh:// refs/changes/17/3817/11
To view, visit
To unsubscribe, visit

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I892091d6401acb2ea91ccb1623af54c6f9635e6c
Gerrit-PatchSet: 11
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Sailesh Mukil <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: David Knupp <>
Gerrit-Reviewer: Henry Robinson <>
Gerrit-Reviewer: Lars Volker <>
Gerrit-Reviewer: Marcel Kornacker <>
Gerrit-Reviewer: Matthew Jacobs <>
Gerrit-Reviewer: Sailesh Mukil <>

View raw message