impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Ho (Code Review)" <>
Subject [Impala-ASF-CR] IMPALA-4856: Include KRPC services in plan fragment's destinations
Date Tue, 29 Aug 2017 18:28:50 GMT
Hello Sailesh Mukil,

I'd like you to reexamine a change.  Please visit

to look at the new patch set (#4).

Change subject: IMPALA-4856: Include KRPC services in plan fragment's destinations

IMPALA-4856: Include KRPC services in plan fragment's destinations

This change allows Impala to publish the address and port
information of KRPC services if it's enabled via the flag
use_krpc. The information is included in a new field in the
backend descriptor published as statestore updates. Scheduler
will also include this information in the destinations of plan
fragments. Also updated the mini-cluster startup script to assign
KRPC ports to Impalad instances.

This patch also takes into account of a problem found in
IMPALA-5795. In particular, the backend descriptor of the
coordinator may not be found in the backend map in the
scheduler if coordinator is not an executor (i.e. dedicated
coordinator). The fix to also check against the local backend

This patch is partially based on an abandoned patch by Henry Robinson.

Testing done: ran core tests with a patch which ignores the use_krpc
flag to exercise the code in scheduler.

Change-Id: I8707bfb5028bbe81d2a042fcf3e6e19f4b719a72
M be/src/common/
M be/src/runtime/
M be/src/runtime/exec-env.h
M be/src/scheduling/
M be/src/scheduling/backend-config.h
M be/src/scheduling/
M be/src/scheduling/
M be/src/scheduling/scheduler.h
M be/src/service/
M be/src/testutil/
M be/src/testutil/in-process-servers.h
M be/src/util/
M be/src/util/network-util.h
M bin/
M common/thrift/ImpalaInternalService.thrift
M common/thrift/StatestoreService.thrift
16 files changed, 149 insertions(+), 53 deletions(-)

  git pull ssh:// refs/changes/60/7760/4
To view, visit
To unsubscribe, visit

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I8707bfb5028bbe81d2a042fcf3e6e19f4b719a72
Gerrit-PatchSet: 4
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Michael Ho <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Henry Robinson <>
Gerrit-Reviewer: Michael Ho <>
Gerrit-Reviewer: Sailesh Mukil <>

View raw message