nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Burgess (JIRA)" <>
Subject [jira] [Updated] (NIFI-4071) ConvertJSONToSQL does not support Hive
Date Fri, 19 Jul 2019 18:14:00 GMT


Matt Burgess updated NIFI-4071:
    Priority: Minor  (was: Major)

> ConvertJSONToSQL does not support Hive
> --------------------------------------
>                 Key: NIFI-4071
>                 URL:
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Matt Burgess
>            Priority: Minor
> Currently, the ConvertJSONToSQL processor does not support Hive as the target database,
either using a HiveConnectionPool or a DBCPConnectionPool configured with a Hive driver. At
the very least:
> 1) A SQLException occurs when determining the auto-increment value. This is due to a
Hive bug (HIVE-13528 []) where the column
is not named according to the spec ([]).
> 2) Column names are returned with the table name prepended (using a dot separator)
> 3) There may be other JDBC API calls that are not supported by the Hive JDBC driver.
> #1 could be solved by checking for "IS_AUTOINCREMENT" then failing over to "IS_AUTO_INCREMENT".
 #2 could be solved with a lastIndexOf("."), as is done in _org.apache.nifi.util.hive.HiveJdbcCommon#createSchema(java.sql.ResultSet,
java.lang.String)_. #3 would take some investigation into the other JDBC API calls being made.

This message was sent by Atlassian JIRA

View raw message