hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raj hadoop <raj.had...@gmail.com>
Subject Sqoop Network Adapter could not establish the connection
Date Tue, 25 Oct 2016 13:20:06 GMT
Dear All,

Could someone please help me with this Sqoop issue

I was able to get list of tables but if I try to import Im getting below
error.

risldev@rislhdpmaster001:~> sqoop import --connect
jdbc:oracle:thin:@10.68.231.64:1521/emitrapreprod --username BGEMITRA
--password bgemitra123# --table SRV_MASTR_TB --target-dir
/user/risldev/sqoopte1  --m 1
Warning: /usr/hdp/2.4.2.0-258/accumulo does not exist! Accumulo imports
will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/10/25 17:12:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.4.2.0-258
16/10/25 17:12:09 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
16/10/25 17:12:09 INFO oracle.OraOopManagerFactory: Data Connector for
Oracle and Hadoop is disabled.
16/10/25 17:12:10 INFO manager.SqlManager: Using default fetchSize of 1000
16/10/25 17:12:10 INFO tool.CodeGenTool: Beginning code generation
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hdp/2.4.2.0-258/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hdp/2.4.2.0-258/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/10/25 17:12:10 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:10 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM "SRV_MASTR_TB" t WHERE 1=0
16/10/25 17:12:10 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
/usr/hdp/2.4.2.0-258/hadoop-mapreduce
Note:
/tmp/sqoop-risldev/compile/37516211806912476be7d0e7b206b081/SRV_MASTR_TB.java
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/10/25 17:12:12 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-risldev/compile/37516211806912476be7d0e7b206b081/SRV_MASTR_TB.jar
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:12 INFO mapreduce.ImportJobBase: Beginning import of
SRV_MASTR_TB
16/10/25 17:12:12 INFO manager.OracleManager: Time zone has been set to GMT
16/10/25 17:12:13 INFO impl.TimelineClientImpl: Timeline service address:
http://rislhdpmaster001:8188/ws/v1/timeline/
16/10/25 17:12:13 INFO client.ConfiguredRMFailoverProxyProvider: Failing
over to rm2
16/10/25 17:12:15 INFO db.DBInputFormat: Using read commited transaction
isolation
16/10/25 17:12:15 INFO mapreduce.JobSubmitter: number of splits:1
16/10/25 17:12:15 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1476946226336_0030
16/10/25 17:12:15 INFO impl.YarnClientImpl: Submitted application
application_1476946226336_0030
16/10/25 17:12:15 INFO mapreduce.Job: The url to track the job:
http://rislhdpmaster003:8088/proxy/application_1476946226336_0030/
16/10/25 17:12:15 INFO mapreduce.Job: Running job: job_1476946226336_0030
16/10/25 17:12:23 INFO mapreduce.Job: Job job_1476946226336_0030 running in
uber mode : false
16/10/25 17:12:23 INFO mapreduce.Job:  map 0% reduce 0%
16/10/25 17:13:27 INFO mapreduce.Job: Task Id :
attempt_1476946226336_0030_m_000000_0, Status : FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException:
java.sql.SQLRecoverableException: IO Error: The Network Adapter could not
establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO
Error: The Network Adapter could not establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter
could not establish the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at
oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at
oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at
org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not
establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at
oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

16/10/25 17:14:31 INFO mapreduce.Job: Task Id :
attempt_1476946226336_0030_m_000000_1, Status : FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException:
java.sql.SQLRecoverableException: IO Error: The Network Adapter could not
establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO
Error: The Network Adapter could not establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter
could not establish the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at
oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at
oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at
org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not
establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at
oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

16/10/25 17:15:35 INFO mapreduce.Job: Task Id :
attempt_1476946226336_0030_m_000000_2, Status : FAILED
Error: java.lang.RuntimeException: java.lang.RuntimeException:
java.sql.SQLRecoverableException: IO Error: The Network Adapter could not
establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)
        at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
        at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:749)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO
Error: The Network Adapter could not establish the connection
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:220)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:165)
        ... 9 more
Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter
could not establish the connection
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:743)
        at
oracle.jdbc.driver.PhysicalConnection.connect(PhysicalConnection.java:666)
        at
oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32)
        at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:566)
        at java.sql.DriverManager.getConnection(DriverManager.java:664)
        at java.sql.DriverManager.getConnection(DriverManager.java:247)
        at
org.apache.sqoop.mapreduce.db.DBConfiguration.getConnection(DBConfiguration.java:302)
        at
org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:213)
        ... 10 more
Caused by: oracle.net.ns.NetException: The Network Adapter could not
establish the connection
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470)
        at
oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:506)
        at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:595)
        at oracle.net.ns.NSProtocol.connect(NSProtocol.java:230)
        at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1452)
        at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:496)
        ... 17 more
Caused by: java.net.SocketTimeoutException: connect timed out
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:589)
        at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:161)
        at oracle.net.nt.ConnOption.connect(ConnOption.java:159)
        at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:428)
        ... 22 more

16/10/25 17:16:41 INFO mapreduce.Job:  map 100% reduce 0%
16/10/25 17:16:41 INFO mapreduce.Job: Job job_1476946226336_0030 failed
with state FAILED due to: Task failed task_1476946226336_0030_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

16/10/25 17:16:41 INFO mapreduce.Job: Counters: 8
        Job Counters
                Failed map tasks=4
                Launched map tasks=4
                Other local map tasks=4
                Total time spent by all maps in occupied slots (ms)=502402
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=251201
                Total vcore-seconds taken by all map tasks=251201
                Total megabyte-seconds taken by all map tasks=2244983337
16/10/25 17:16:41 WARN mapreduce.Counters: Group FileSystemCounters is
deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
16/10/25 17:16:41 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
268.28 seconds (0 bytes/sec)
16/10/25 17:16:41 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
16/10/25 17:16:41 INFO mapreduce.ImportJobBase: Retrieved 0 records.

Mime
View raw message