hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kilaru, Sambaiah" <Sambaiah_Kil...@intuit.com>
Subject Re: Sqoop Network Adapter could not establish the connection
Date Thu, 27 Oct 2016 06:09:36 GMT
Raj,
Check from all datanodes if you are able to connect to Oracle. Do you have ACLs?

Thanks,
Sam

From: Raj hadoop <raj.hadoop@gmail.com<mailto:raj.hadoop@gmail.com>>
Date: Tuesday, October 25, 2016 at 6:50 PM
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Subject: Sqoop Network Adapter could not establish the connection

Dear All,

Could someone please help me with this Sqoop issue

I was able to get list of tables but if I try to import Im getting below error.

risldev@rislhdpmaster001:~> sqoop import --connect jdbc:oracle:thin:@10.68.231.64:1521/emitrapreprod<http://jdbc:oracle:thin:@10.68.231.64:1521/emitrapreprod>
--username BGEMITRA --password bgemitra123# --table SRV_MASTR_TB --target-dir /user/risldev/sqoopte1
 --m 1
Warning: /usr/hdp/2.4.2.0-258/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/10/25 17:12:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-258
16/10/25 17:12:09 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure.
Consider using -P instead.
16/10/25 17:12:09 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is
disabled.
16/10/25 17:12:10 INFO manager.SqlManager: Using default fetchSize of 1000
16/10/25 17:12:10 INFO tool.CodeGenTool: Beginning code generation
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.4.2.0-258/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.4.2.0-258/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/10/25 17:12:10 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:10 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM "SRV_MASTR_TB"
t WHERE 1=0
16/10/25 17:12:10 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.4.2.0-258/hadoop-mapreduce
Note: /tmp/sqoop-risldev/compile/37516211806912476be7d0e7b206b081/SRV_MASTR_TB.java uses or
overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/10/25 17:12:12 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-risldev/compile/37516211806912476be7d0e7b206b081/SRV_MASTR_TB.jar
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:12 INFO mapreduce.ImportJobBase: Beginning import of SRV_MASTR_TB
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:13 INFO impl.TimelineClientImpl: Timeline service address: http://rislhdpmaster001:8188/ws/v1/timeline/
16/10/25 17:12:13 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
16/10/25 17:12:15 INFO db.DBInputFormat: Using read commited transaction isolation
16/10/25 17:12:15 INFO mapreduce.JobSubmitter: number of splits:1
16/10/25 17:12:15 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1476946226336_0030
16/10/25 17:12:15 INFO impl.YarnClientImpl: Submitted application application_1476946226336_0030
16/10/25 17:12:15 INFO mapreduce.Job: The url to track the job: http://rislhdpmaster003:8088/proxy/application_1476946226336_0030/
16/10/25 17:12:15 INFO mapreduce.Job: Running job: job_1476946226336_0030
16/10/25 17:12:23 INFO mapreduce.Job: Job job_1476946226336_0030 running in uber mode : false
16/10/25 17:12:23 INFO mapreduce.Job:  map 0% reduce 0%
16/10/25 17:13:27 INFO mapreduce.Job: Task Id : attempt_1476946226336_0030_m_000000_0, Status
: FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLRecoverableException:
IO Error: The Network Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO Error: The Network
Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish
the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

16/10/25 17:14:31 INFO mapreduce.Job: Task Id : attempt_1476946226336_0030_m_000000_1, Status
: FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLRecoverableException:
IO Error: The Network Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO Error: The Network
Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish
the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

16/10/25 17:15:35 INFO mapreduce.Job: Task Id : attempt_1476946226336_0030_m_000000_2, Status
: FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLRecoverableException:
IO Error: The Network Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO Error: The Network
Adapter could not establish the connection
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish
the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

16/10/25 17:16:41 INFO mapreduce.Job:  map 100% reduce 0%
16/10/25 17:16:41 INFO mapreduce.Job: Job job_1476946226336_0030 failed with state FAILED
due to: Task failed task_1476946226336_0030_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

16/10/25 17:16:41 INFO mapreduce.Job: Counters: 8
        Job Counters
                Failed map tasks=4
                Launched map tasks=4
                Other local map tasks=4
                Total time spent by all maps in occupied slots (ms)=502402
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=251201
                Total vcore-seconds taken by all map tasks=251201
                Total megabyte-seconds taken by all map tasks=2244983337
16/10/25 17:16:41 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter
instead
16/10/25 17:16:41 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 268.28 seconds (0 bytes/sec)
16/10/25 17:16:41 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is
deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
16/10/25 17:16:41 INFO mapreduce.ImportJobBase: Retrieved 0 records.


Mime
View raw message