atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adil Kaleem (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-788) Incremental import from Teradata via sqoop
Date Sun, 15 May 2016 06:59:12 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283801#comment-15283801
] 

Adil Kaleem commented on ATLAS-788:
-----------------------------------

I've been trying sqoop import from Teradata for very large tables; more than 3 TB each table,
BLC ones also more than 1.5 TB. 

I am not able to select the specified range of dates from within sqoop query. Below is my
query:

sqoop import --connect jdbc:teradata://xxx.xxx.x.xx/DATABASE=dbname --driver com.teradata.jdbc.TeraDriver
--username USR --password pass --query "SELECT sqoop_import_query_alias.network_1, sqoop_import_query_alias.network_2,
sqoop_import_query_alias.network_3, sqoop_import_query_alias.network_4, sqoop_import_query_alias.activity_time
FROM tableName sqoop_import_query_alias where activity_time BETWEEN '1160101 00:00:00' AND
'1160102 00:00:00' \$CONDITIONS" --target-dir /apps/hive/warehouse/list.db/tableName -m 8
--check-column 'cast(sqoop_import_query_alias.ACTIVITY_START_TIME AS DATE)' --incremental
append --split-by sqoop_import_query_alias.network_1

The selection of table between specified dates always lead to error:
16/05/12 10:06:25 INFO manager.SqlManager: Using default fetchSize of 1000
16/05/12 10:06:25 INFO tool.CodeGenTool: Beginning code generation
16/05/12 10:06:26 ERROR manager.SqlManager: Error executing statement: java.sql.SQLException:
[Teradata Database] [TeraJDBC 15.10.00.09] [Error 3706] [SQLState 42000] Syntax error: expected
something between '(' and the integer '1'.
java.sql.SQLException: [Teradata Database] [TeraJDBC 15.10.00.09] [Error 3706] [SQLState 42000]
Syntax error: expected something between '(' and the integer '1'.


Is there a bug with TDCH that doesn't support selective imports from Teradata via sqoop?



> Incremental import from Teradata via sqoop
> ------------------------------------------
>
>                 Key: ATLAS-788
>                 URL: https://issues.apache.org/jira/browse/ATLAS-788
>             Project: Atlas
>          Issue Type: Bug
>            Reporter: Adil Kaleem
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message