impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Impala Public Jenkins (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-4856, IMPALA-4872: Include KRPC services in plan fragment's destinations
Date Thu, 31 Aug 2017 02:09:55 GMT
Impala Public Jenkins has submitted this change and it was merged.

Change subject: IMPALA-4856, IMPALA-4872: Include KRPC services in plan fragment's destinations

IMPALA-4856, IMPALA-4872: Include KRPC services in plan fragment's destinations

This change allows Impala to publish the IP address and port
information of KRPC services if it's enabled via the flag
use_krpc. The information is included in a new field in the
backend descriptor published as statestore updates. Scheduler
will also include this information in the destinations of plan
fragments. Also updated the mini-cluster startup script to assign
KRPC ports to Impalad instances.

This patch also takes into account of a problem found in
IMPALA-5795. In particular, the backend descriptor of the
coordinator may not be found in the backend map in the
scheduler if coordinator is not an executor (i.e. dedicated
coordinator). The fix to also check against the local backend

This patch is partially based on an abandoned patch by Henry Robinson.

Testing done: ran core tests with a patch which ignores the use_krpc
flag to exercise the code in scheduler.

Change-Id: I8707bfb5028bbe81d2a042fcf3e6e19f4b719a72
Reviewed-by: Michael Ho <>
Tested-by: Impala Public Jenkins
M be/src/common/
M be/src/runtime/
M be/src/runtime/exec-env.h
M be/src/scheduling/
M be/src/scheduling/backend-config.h
M be/src/scheduling/
M be/src/scheduling/
M be/src/scheduling/scheduler.h
M be/src/service/
M be/src/testutil/
M be/src/testutil/in-process-servers.h
M be/src/util/
M be/src/util/network-util.h
M bin/
M common/thrift/ImpalaInternalService.thrift
M common/thrift/StatestoreService.thrift
16 files changed, 158 insertions(+), 60 deletions(-)

  Impala Public Jenkins: Verified
  Michael Ho: Looks good to me, approved

To view, visit
To unsubscribe, visit

Gerrit-MessageType: merged
Gerrit-Change-Id: I8707bfb5028bbe81d2a042fcf3e6e19f4b719a72
Gerrit-PatchSet: 8
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Michael Ho <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Henry Robinson <>
Gerrit-Reviewer: Impala Public Jenkins
Gerrit-Reviewer: Michael Ho <>
Gerrit-Reviewer: Sailesh Mukil <>

View raw message