hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shuaishuai Nie (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5072) [WebHCat]Enable directly invoke Sqoop job through Templeton
Date Fri, 18 Apr 2014 22:18:18 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shuaishuai Nie updated HIVE-5072:
---------------------------------

    Attachment: HIVE-5072.5.patch

Hi [~ekoifman].Changed the e2e test to pass 'user.name' using query parameter in HIVE-5072.5.patch.

For the "version/sqoop", the link (https://sqoop.apache.org/docs/1.99.1/CommandLineClient.html#show-version-function)
is for Sqoop 2. For Sqoop 1, only way to get the version is using command "Sqoop version".
This require templeton to start a launcher job and run the command on one of the worker node.
This can be done through "sqoop delegator" added in this patch. However we cannot do the same
for Sqoop as what is done in "version/hive" and "version/hadoop" to get the version number
interactively. I propose creating separate JIRA for the implementation of "version/Sqoop"
and "version/Pig" and discuss the design there if the feature is required since there is not
a straight forward way to do this.

> [WebHCat]Enable directly invoke Sqoop job through Templeton
> -----------------------------------------------------------
>
>                 Key: HIVE-5072
>                 URL: https://issues.apache.org/jira/browse/HIVE-5072
>             Project: Hive
>          Issue Type: Improvement
>          Components: WebHCat
>    Affects Versions: 0.12.0
>            Reporter: Shuaishuai Nie
>            Assignee: Shuaishuai Nie
>         Attachments: HIVE-5072.1.patch, HIVE-5072.2.patch, HIVE-5072.3.patch, HIVE-5072.4.patch,
HIVE-5072.5.patch, Templeton-Sqoop-Action.pdf
>
>
> Now it is hard to invoke a Sqoop job through templeton. The only way is to use the classpath
jar generated by a sqoop job and use the jar delegator in Templeton. We should implement Sqoop
Delegator to enable directly invoke Sqoop job through Templeton.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message