hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wilson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1555) JDBC Storage Handler
Date Tue, 08 Mar 2011 18:40:06 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004129#comment-13004129
] 

Andrew Wilson commented on HIVE-1555:
-------------------------------------

Hi,

Can I get this issue assigned to me? I have a basic implementation working, which I'd like
to contribute. 

It wraps the DBInputFormat and DBOutputFormat classes. 

It expects values for the DBConfiguration properties to be provided through the SERDEPROPERTIES
block in the create table statement. The configureTableJobProperties() method copies these
properties out of the table description and into each job context.

It also allows users to set SerDe properties which will cause the DBOutputFormat to generate
UPSERT sql statements or DELETE sql statements instead of the vanilla INSERT sql generated
by default. Right now this feature has a MySql bias. I am still trying to decide what the
best way is to make this more database vendor agnostic.

Andrew


> JDBC Storage Handler
> --------------------
>
>                 Key: HIVE-1555
>                 URL: https://issues.apache.org/jira/browse/HIVE-1555
>             Project: Hive
>          Issue Type: New Feature
>          Components: JDBC
>            Reporter: Bob Robertson
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> With the Cassandra and HBase Storage Handlers I thought it would make sense to include
a generic JDBC RDBMS Storage Handler so that you could import a standard DB table into Hive.
Many people must want to perform HiveQL joins, etc against tables in other systems etc.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message