impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (JIRA)" <>
Subject [jira] [Resolved] (IMPALA-5184) Get Impala working against Hive2 APIs
Date Mon, 08 May 2017 21:46:05 GMT


Tim Armstrong resolved IMPALA-5184.
       Resolution: Fixed
    Fix Version/s: Impala 2.9.0

IMPALA-5184: build fe against both Hive 1 & 2 APIs

This adds a compatibility shim layer with Hive 1 and Hive 2
implementations. The version-specific code lives in
fe/src/compat-hive-$IMPALA_HIVE_MAJOR_VERSION and

The shim adds wrapper methods to handle differing method signatures
and and config variables that changed slightly.

Some thrift classes were also moved from the 'cli' to 'rpc' package.
We work around these by implementing subclasses with the same name
in a different package for compatibility or by implementing shim
methods that operate on the classes. We also need to change the
package in the TCLIService.thrift, which is done with a

Also avoid the sticky config variable problem with some of the source
paths by requiring an _OVERRIDE suffix on the variable to override it
from the environment.

Made sure that I could build Impala on master as normal, and also
with the following config overrides in bin/

  export IMPALA_HADOOP_VERSION=3.0.0-alpha1-cdh6.x-SNAPSHOT
  export IMPALA_HIVE_VERSION=2.1.0-cdh6.x-SNAPSHOT

I manually assembled the dependencies by copying the following files
from the Hive 2 source and from a Hadoop 3 build:

Change-Id: Ifbc265281c04fe3136bc3c920dbac966742ce09a
Reviewed-by: Tim Armstrong <>
Tested-by: Impala Public Jenkins

> Get Impala working against Hive2 APIs
> -------------------------------------
>                 Key: IMPALA-5184
>                 URL:
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Catalog
>    Affects Versions: Impala 2.9.0
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>             Fix For: Impala 2.9.0

This message was sent by Atlassian JIRA

View raw message