hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Created] (HIVE-8588) sqoop REST endpoint fails to send appropriate JDBC driver to the cluster
Date Fri, 24 Oct 2014 04:02:33 GMT
Eugene Koifman created HIVE-8588:

             Summary: sqoop REST endpoint fails to send appropriate JDBC driver to the cluster
                 Key: HIVE-8588
             Project: Hive
          Issue Type: Bug
          Components: WebHCat
    Affects Versions: 0.14.0
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman

This is originally discovered by [~deepesh]
When running a Sqoop integration test from WebHCat
curl --show-error -d command="export -libjars hdfs:///tmp/mysql-connector-java.jar --connect
jdbc:mysql://deepesh-c6-1.cs1cloud.internal/sqooptest --username sqoop --password passwd --export-dir
/tmp/templeton_test_data/sqoop --table person" -d statusdir=sqoop.output -X POST "http://deepesh-c6-1.cs1cloud.internal:50111/templeton/v1/sqoop?"
the job is failing with the following error:
$ hadoop fs -cat /user/hrt_qa/sqoop.output/stderr
14/10/15 23:52:53 INFO sqoop.Sqoop: Running Sqoop version:
14/10/15 23:52:53 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure.
Consider using -P instead.
14/10/15 23:52:54 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/10/15 23:52:54 INFO tool.CodeGenTool: Beginning code generation
14/10/15 23:52:54 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException:
Could not load db driver class: com.mysql.jdbc.Driver
java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver
	at org.apache.sqoop.manager.SqlManager.makeConnection(
	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(
	at org.apache.sqoop.manager.SqlManager.execute(
	at org.apache.sqoop.manager.SqlManager.execute(
	at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(
	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(
	at org.apache.sqoop.manager.SqlManager.getColumnTypes(
	at org.apache.sqoop.manager.ConnManager.getColumnTypes(
	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(
	at org.apache.sqoop.orm.ClassWriter.generate(
	at org.apache.sqoop.tool.CodeGenTool.generateORM(
	at org.apache.sqoop.tool.ExportTool.exportTable(
	at org.apache.sqoop.Sqoop.runSqoop(
	at org.apache.sqoop.Sqoop.runTool(
	at org.apache.sqoop.Sqoop.runTool(
	at org.apache.sqoop.Sqoop.main(
Note that the Sqoop tar bundle does not contain the JDBC connector jar. I think the problem
here maybe that the mysql connector jar added to libjars isn't available to the Sqoop tool
which first connects to the database through JDBC driver to collect some table information
before running the MR job. libjars will only add the connector jar for the MR job and not
the local one.

This message was sent by Atlassian JIRA

View raw message