pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1229) allow pig to write output into a JDBC db
Date Thu, 01 Apr 2010 04:14:27 GMT

    [ https://issues.apache.org/jira/browse/PIG-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852243#action_12852243

Ankur commented on PIG-1229:

   Thanks for the review comments. Accepting the store location via setStoreLocation() definitely
makes sense. However I am not sure about checking database reachability in checkOutputSepcs()

since that may be called on the client side as well and the DB machine may not be reachable
from the client machine. Isn't OutputFormat's setupTask()  a better place to do a DB availability
checks ?
This sounds like a reasonable ask before a commit. I will incorporate this and submit a new

> Doing DataType.find() ....
I assume this is what you have in mind :-
    1. Getting DB Schema information for the table we are writing to.
    2. Use checkSchema() API to validate this with Pig supplied schema and cache it.
    3. Use the cached information in the putNext() method.

This is more of a performance enhancement and looks like more work. So I would prefer if we
track this as a JIRA for DBStorage.

> allow pig to write output into a JDBC db
> ----------------------------------------
>                 Key: PIG-1229
>                 URL: https://issues.apache.org/jira/browse/PIG-1229
>             Project: Pig
>          Issue Type: New Feature
>          Components: impl
>            Reporter: Ian Holsman
>            Assignee: Ankur
>            Priority: Minor
>             Fix For: 0.8.0
>         Attachments: jira-1229-v2.patch
> UDF to store data into a DB

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message