From dev-return-35528-archive-asf-public=cust-asf.ponee.io@sqoop.apache.org Tue Jan 16 20:57:09 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id C799C18065B for ; Tue, 16 Jan 2018 20:57:09 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B754E160C34; Tue, 16 Jan 2018 19:57:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D63D8160C1D for ; Tue, 16 Jan 2018 20:57:08 +0100 (CET) Received: (qmail 11713 invoked by uid 500); 16 Jan 2018 19:57:08 -0000 Mailing-List: contact dev-help@sqoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@sqoop.apache.org Delivered-To: mailing list dev@sqoop.apache.org Received: (qmail 11701 invoked by uid 99); 16 Jan 2018 19:57:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Jan 2018 19:57:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 881311A2F55 for ; Tue, 16 Jan 2018 19:57:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.709 X-Spam-Level: X-Spam-Status: No, score=-100.709 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001, USER_IN_WHITELIST=-100, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id iotcvfSnsrwl for ; Tue, 16 Jan 2018 19:57:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 8C4965FBEE for ; Tue, 16 Jan 2018 19:57:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 49C10E25D6 for ; Tue, 16 Jan 2018 19:57:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id DD9A12130B for ; Tue, 16 Jan 2018 19:57:00 +0000 (UTC) Date: Tue, 16 Jan 2018 19:57:00 +0000 (UTC) From: "Chaitanya Krishna Kande (JIRA)" To: dev@sqoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (SQOOP-3277) Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Chaitanya Krishna Kande created SQOOP-3277: ---------------------------------------------- Summary: Sqoop from Oracle RDB database is failing with except= ion SQLException in nextKeyValue Key: SQOOP-3277 URL: https://issues.apache.org/jira/browse/SQOOP-3277 Project: Sqoop Issue Type: Bug Components: test Affects Versions: 1.4.6 Environment: Production : Sqoop from Oracle RDB database is failing with exception SQLException in ne= xtKeyValue Sqoop from Oracle RDB database is failing with exception SQLException in ne= xtKeyValue. Below is the error log 17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is = deprecated. Instead, use mapreduce.job.queuename 17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: j= ob_1512111796128_818880 17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized ex= ternal token manager class - com.mapr.hadoop.yarn.security.MapRTicketManage= r 17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application applicati= on_1512111796128_818880 17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job: https://dbs= ld0069.uhc.com:8090/proxy/application_1512111796128_818880/ 17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880 17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running = in uber mode : false 17/12/22 11:20:43 INFO mapreduce.Job:=C2=A0 map 0% reduce 0% 17/12/22 15:13:18 INFO mapreduce.Job: Task Id : attempt_1512111796128_81888= 0_m_000000_0, Status : FAILED Error: java.io.IOException: SQLException in nextKeyValue at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader= .java:277) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(Ma= pTask.java:565) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextI= mpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(W= rappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.jav= a:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio= n.java:1595) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data chan= nel at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:= 1128) at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleRe= sultSetImpl.java:373) at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277= ) at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader= .java:237) ... 12 more Caused by: oracle.net.ns.NetException: End of TNS data channel at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308) at oracle.net.ns.NetInputStream.read(NetInputStream.java:260) at oracle.net.ns.NetInputStream.read(NetInputStream.java:185) at oracle.net.ns.NetInputStream.read(NetInputStream.java:102) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketI= nputStreamWrapper.java:124) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStream= Wrapper.java:80) at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137) at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290) at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192) at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.jav= a:207) at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:= 1119) ... 15 more =C2=A0 =C2=A0 --> Database from which we are sqooping data is Oracle RDB. We have tried o= ut different work arounds. 1. Mapping all the columns to String while sqooping 2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null= while sqooping. This work around successfully sqooped most of the tables but still we are f= acing the exception for few tables. Does any one came across this issue whie sqooping? Could you please provide= any suggestions/help on how to resolve this Reporter: Chaitanya Krishna Kande Sqoop from Oracle RDB database is failing with exception SQLException in ne= xtKeyValue. Below is the error log 17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is = deprecated. Instead, use mapreduce.job.queuename 17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: j= ob_1512111796128_818880 17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized ex= ternal token manager class - com.mapr.hadoop.yarn.security.MapRTicketManage= r 17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application applicati= on_1512111796128_818880 17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job: https://dbs= ld0069.uhc.com:8090/proxy/application_1512111796128_818880/ 17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880 17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running = in uber mode : false 17/12/22 11:20:43 INFO mapreduce.Job:=C2=A0 map 0% reduce 0% 17/12/22 15:13:18 INFO mapreduce.Job: Task Id : attempt_1512111796128_81888= 0_m_000000_0, Status : FAILED Error: java.io.IOException: SQLException in nextKeyValue at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader= .java:277) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(Ma= pTask.java:565) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextI= mpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(W= rappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.jav= a:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformatio= n.java:1595) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data chan= nel at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:= 1128) at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleRe= sultSetImpl.java:373) at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277= ) at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader= .java:237) ... 12 more Caused by: oracle.net.ns.NetException: End of TNS data channel at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308) at oracle.net.ns.NetInputStream.read(NetInputStream.java:260) at oracle.net.ns.NetInputStream.read(NetInputStream.java:185) at oracle.net.ns.NetInputStream.read(NetInputStream.java:102) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketI= nputStreamWrapper.java:124) at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStream= Wrapper.java:80) at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137) at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290) at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192) at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531) at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.jav= a:207) at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:= 1119) ... 15 more =C2=A0 =C2=A0 --> Database from which we are sqooping data is Oracle RDB. We have tried o= ut different work arounds. 1. Mapping all the columns to String while sqooping 2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null= while sqooping. This work around successfully sqooped most of the tables but still we are f= acing the exception for few tables. Does any one came across this issue whie sqooping? Could you please provide= any suggestions/help on how to resolve this -- This message was sent by Atlassian JIRA (v7.6.3#76005)