hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lukas Waldmann (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-16221) Hive jdbc driver should support PreparedStatement.addBatch and executeBatch
Date Wed, 15 Mar 2017 13:06:48 GMT
Lukas Waldmann created HIVE-16221:
-------------------------------------

             Summary: Hive jdbc driver should support PreparedStatement.addBatch and executeBatch
                 Key: HIVE-16221
                 URL: https://issues.apache.org/jira/browse/HIVE-16221
             Project: Hive
          Issue Type: Improvement
            Reporter: Lukas Waldmann


Currently when inserting data to Hive DB using jdbc driver you can insert multiple rows only
by concatenating strings  of values, which is very ineffective and for tables with big number
of columns can lead to insertion of just one or few lines at once because of String length
limitation.
Furthermore each insert creates a new file on HDFS increasing the strain on the resource manager.

Batch processing should solve this problem as multiple inserts can be merged to one by the
driver.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message