hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-10227) Concrete implementation of Export/Import based ReplicationTaskFactory
Date Fri, 17 Apr 2015 21:17:59 GMT

     [ https://issues.apache.org/jira/browse/HIVE-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sushanth Sowmyan updated HIVE-10227:
------------------------------------
    Attachment: HIVE-10227.2.patch

Updating patch after initial feedback from Mithun on adding HCatClient.getConfVal, and using
that to change how ReplicationTask.create and its factory loading works, instead of statically
initializing a HiveConf.

Also, added batching semantics for HCatReplicationTaskIterator so that even if a user specifies
-1 as their max_events, we should not have OOM issues. In addition, HCatReplicationTaskIterator
always returns max_events entries if available, irrespective of whether or not there are max_events
relevant events in the next eventFrom+max_events events(old behaviour was that it'd return
at-most max_events events as it simply passed these parameters to the metastore). Basically,
HCatReplicationTaskIterator has been made more robust, and is now the primary interface point
to its users.

> Concrete implementation of Export/Import based ReplicationTaskFactory
> ---------------------------------------------------------------------
>
>                 Key: HIVE-10227
>                 URL: https://issues.apache.org/jira/browse/HIVE-10227
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Import/Export
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-10227.2.patch, HIVE-10227.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message