apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vlad Rozov <v.ro...@datatorrent.com>
Subject Re: DT Exception while streaming byte array to object array
Date Thu, 18 Aug 2016 22:26:18 GMT
These errors mean that a downstream operator exited without 
closing/disconnecting socket to the buffer server. Please check 
application master log to identify container/operator that fails first.

Vlad

On 8/18/16 10:57, Mukkamula, Suryavamshivardhan (CWM-NR) wrote:
> Hi Team,
> Can you please throw some light as why I am getting these exceptions. 
> We are trying to stream input file into byte array and converting them 
> to object arrays. We are getting these exceptions while doing 
> converting byte array to object array.
> 2016-08-18 12:36:05,272 INFO  engine.StreamingContainer 
> (StreamingContainer.java:main(292)) - Child starting with classpath: 
> ./apex-bufferserver-3.3.1-dt20160522.jar:./async-http-client-1.7.20.jar:./javax.mail-1.5.0.jar:./joda-time-2.9.1.jar:./commons-compiler-2.7.8.jar:./parquet-jackson-1.7.0.jar:./malhar-library-3.3.0-incubating.jar:./geronimo-jms_1.1_spec-1.1.1.jar:./commons-codec-1.4.jar:./commons-lang3-3.1.jar:./apex-api-3.3.1-dt20160522.jar:./parquet-encoding-1.7.0.jar:./jetty-continuation-8.1.10.v20130312.jar:./jersey-client-1.9.jar:./jsch-0.1.53.jar:./parquet-format-2.3.0-incubating.jar:./activemq-client-5.8.0.jar:./jetty-websocket-8.1.10.v20130312.jar:./apex-common-3.3.1-dt20160522.jar:./commons-logging-1.1.1.jar:./bval-core-0.5.jar:./mbassador-1.1.9.jar:./jersey-core-1.9.jar:./paranamer-2.3.jar:./activation-1.1.jar:./jetty-servlet-8.1.10.v20130312.jar:./validation-api-1.1.0.Final.jar:./jetty-io-8.1.10.v20130312.jar:./hawtbuf-1.9.jar:./jms-api-1.1-rev-1.jar:./avro-1.7.4.jar:./jackson-core-asl-1.9.2.jar:./parquet-common-1.7.0.jar:./terajdbc4-15.10.00.14.jar:./fastutil-6.6.4.jar:./apex-engine-3.3.1-dt20160522.jar:./jetty-security-8.1.10.v20130312.jar:./slf4j-api-1.7.5.jar:./xbean-asm5-shaded-4.3.jar:./bval-jsr303-0.5.jar:./httpcore-4.3.2.jar:./minlog-1.2.jar:./vertica-jdbc-7.2.1-0.jar:./parquet-hadoop-1.7.0.jar:./commons-beanutils-1.8.3.jar:./snappy-java-1.0.4.1.jar:./parquet-avro-1.7.0.jar:./dt-contrib-solace-3.0.0.jar:./netlet-1.2.1.jar:./jetty-util-8.1.10.v20130312.jar:./flatpack-3.4.2.jar:./jersey-apache-client4-1.9.jar:./opencsv-2.3.jar:./parquet-generator-1.7.0.jar:./commons-compress-1.4.1.jar:./parquet-column-1.7.0.jar:./xz-1.0.jar:./kryo-2.24.0.jar:./jetty-http-8.1.10.v20130312.jar:./httpclient-4.3.5.jar:./geronimo-j2ee-management_1.1_spec-1.0.1.jar:./named-regexp-0.2.3.jar:./jetty-server-8.1.10.v20130312.jar:./malhar-contrib-3.3.0-incubating.jar:./DataPipeline-0.0.1-SNAPSHOT.jar:./tdgssconfig-15.10.00.14.jar:./jackson-mapper-asl-1.9.2.jar:./poi-3.9.jar:/usr/hdp/current/hadoop-client/conf:/usr/hdp/current/hadoop-client/hadoop-azure-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-aws.jar:/usr/hdp/current/hadoop-client/hadoop-nfs-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-common.jar:/usr/hdp/current/hadoop-client/hadoop-annotations-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-auth-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-common-tests.jar:/usr/hdp/current/hadoop-client/hadoop-azure.jar:/usr/hdp/current/hadoop-client/hadoop-aws-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-nfs.jar:/usr/hdp/current/hadoop-client/hadoop-annotations.jar:/usr/hdp/current/hadoop-client/hadoop-common-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/hadoop-auth.jar:/usr/hdp/current/hadoop-client/hadoop-common-2.7.1.2.3.2.0-2950-tests.jar:/usr/hdp/current/hadoop-client/lib/hadoop-lzo-0.6.0.2.3.2.0-2950-test.jar:/usr/hdp/current/hadoop-client/lib/commons-codec-1.4.jar:/usr/hdp/current/hadoop-client/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hadoop-client/lib/servlet-api-2.5.jar:/usr/hdp/current/hadoop-client/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hadoop-client/lib/xmlenc-0.52.jar:/usr/hdp/current/hadoop-client/lib/ranger-plugins-common-0.5.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/jersey-server-1.9.jar:/usr/hdp/current/hadoop-client/lib/commons-configuration-1.6.jar:/usr/hdp/current/hadoop-client/lib/guava-11.0.2.jar:/usr/hdp/current/hadoop-client/lib/slf4j-log4j12-1.7.10.jar:/usr/hdp/current/hadoop-client/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hadoop-client/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hadoop-client/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hadoop-client/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hadoop-client/lib/curator-client-2.7.1.jar:/usr/hdp/current/hadoop-client/lib/jsp-api-2.1.jar:/usr/hdp/current/hadoop-client/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hadoop-client/lib/jersey-json-1.9.jar:/usr/hdp/current/hadoop-client/lib/gson-2.2.4.jar:/usr/hdp/current/hadoop-client/lib/commons-digester-1.8.jar:/usr/hdp/current/hadoop-client/lib/netty-3.6.2.Final.jar:/usr/hdp/current/hadoop-client/lib/slf4j-api-1.7.10.jar:/usr/hdp/current/hadoop-client/lib/commons-logging-1.1.3.jar:/usr/hdp/current/hadoop-client/lib/noggit-0.6.jar:/usr/hdp/current/hadoop-client/lib/log4j-1.2.17.jar:/usr/hdp/current/hadoop-client/lib/junit-4.11.jar:/usr/hdp/current/hadoop-client/lib/jackson-annotations-2.2.3.jar:/usr/hdp/current/hadoop-client/lib/jettison-1.1.jar:/usr/hdp/current/hadoop-client/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hadoop-client/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hadoop-client/lib/eclipselink-2.5.2-M1.jar:/usr/hdp/current/hadoop-client/lib/commons-httpclient-3.1.jar:/usr/hdp/current/hadoop-client/lib/jersey-core-1.9.jar:/usr/hdp/current/hadoop-client/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hadoop-client/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hadoop-client/lib/ranger-hdfs-plugin-0.5.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/commons-io-2.4.jar:/usr/hdp/current/hadoop-client/lib/commons-collections-3.2.1.jar:/usr/hdp/current/hadoop-client/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hadoop-client/lib/azure-storage-2.2.0.jar:/usr/hdp/current/hadoop-client/lib/zookeeper-3.4.6.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/current/hadoop-client/lib/jackson-core-2.2.3.jar:/usr/hdp/current/hadoop-client/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hadoop-client/lib/hadoop-lzo-0.6.0.2.3.2.0-2950-sources.jar:/usr/hdp/current/hadoop-client/lib/httpmime-4.2.5.jar:/usr/hdp/current/hadoop-client/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hadoop-client/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hadoop-client/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hadoop-client/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hadoop-client/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hadoop-client/lib/hamcrest-core-1.3.jar:/usr/hdp/current/hadoop-client/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/current/hadoop-client/lib/mockito-all-1.8.5.jar:/usr/hdp/current/hadoop-client/lib/jackson-databind-2.2.3.jar:/usr/hdp/current/hadoop-client/lib/ranger-yarn-plugin-0.5.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/asm-3.2.jar:/usr/hdp/current/hadoop-client/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hadoop-client/lib/xz-1.0.jar:/usr/hdp/current/hadoop-client/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hadoop-client/lib/jsr305-3.0.0.jar:/usr/hdp/current/hadoop-client/lib/hadoop-lzo-0.6.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/javax.persistence-2.1.0.jar:/usr/hdp/current/hadoop-client/lib/commons-cli-1.2.jar:/usr/hdp/current/hadoop-client/lib/hadoop-common-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/ojdbc6.jar:/usr/hdp/current/hadoop-client/lib/httpclient-4.2.5.jar:/usr/hdp/current/hadoop-client/lib/commons-lang-2.6.jar:/usr/hdp/current/hadoop-client/lib/commons-net-3.1.jar:/usr/hdp/current/hadoop-client/lib/httpcore-4.2.5.jar:/usr/hdp/current/hadoop-client/lib/activation-1.1.jar:/usr/hdp/current/hadoop-client/lib/avro-1.7.4.jar:/usr/hdp/current/hadoop-client/lib/ranger-plugins-audit-0.5.0.2.3.2.18-2.jar:/usr/hdp/current/hadoop-client/lib/paranamer-2.3.jar:/usr/hdp/current/hadoop-client/lib/ranger_solrj-0.5.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/ranger-plugins-cred-0.5.0.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-client/lib/jsch-0.1.42.jar:/usr/hdp/current/hadoop-client/lib/stax-api-1.0-2.jar:/usr/hdp/current/hadoop-client/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hadoop-client/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hadoop-client/lib/jets3t-0.9.0.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-nfs.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-tests.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-2.7.1.2.3.2.0-2950-tests.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs.jar:/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-nfs-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-codec-1.4.jar:/usr/hdp/current/hadoop-hdfs-client/lib/servlet-api-2.5.jar:/usr/hdp/current/hadoop-hdfs-client/lib/xmlenc-0.52.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jersey-server-1.9.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hadoop-hdfs-client/lib/guava-11.0.2.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hadoop-hdfs-client/lib/netty-3.6.2.Final.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-logging-1.1.3.jar:/usr/hdp/current/hadoop-hdfs-client/lib/log4j-1.2.17.jar:/usr/hdp/current/hadoop-hdfs-client/lib/okhttp-2.4.0.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jersey-core-1.9.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-io-2.4.jar:/usr/hdp/current/hadoop-hdfs-client/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hadoop-hdfs-client/lib/netty-all-4.0.23.Final.jar:/usr/hdp/current/hadoop-hdfs-client/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hadoop-hdfs-client/lib/xercesImpl-2.9.1.jar:/usr/hdp/current/hadoop-hdfs-client/lib/asm-3.2.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hadoop-hdfs-client/lib/jsr305-3.0.0.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-cli-1.2.jar:/usr/hdp/current/hadoop-hdfs-client/lib/okio-1.4.0.jar:/usr/hdp/current/hadoop-hdfs-client/lib/commons-lang-2.6.jar:/usr/hdp/current/hadoop-hdfs-client/lib/xml-apis-1.3.04.jar:/usr/hdp/current/hadoop-hdfs-client/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-resourcemanager.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-timeline-plugins-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-client.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-common-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-web-proxy-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-api-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-nodemanager.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-common-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-registry.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-nodemanager-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-timeline-plugins.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-web-proxy.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-sharedcachemanager-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-resourcemanager-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-client-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-distributedshell.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-common.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-tests-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-common.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-registry-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-tests.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-server-applicationhistoryservice-2.7.1.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/hadoop-yarn-api.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-codec-1.4.jar:/usr/hdp/current/hadoop-yarn-client/lib/java-xmlbuilder-0.4.jar:/usr/hdp/current/hadoop-yarn-client/lib/servlet-api-2.5.jar:/usr/hdp/current/hadoop-yarn-client/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hadoop-yarn-client/lib/xmlenc-0.52.jar:/usr/hdp/current/hadoop-yarn-client/lib/jersey-server-1.9.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-configuration-1.6.jar:/usr/hdp/current/hadoop-yarn-client/lib/guava-11.0.2.jar:/usr/hdp/current/hadoop-yarn-client/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hadoop-yarn-client/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/current/hadoop-yarn-client/lib/curator-recipes-2.7.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/snappy-java-1.0.4.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/curator-client-2.7.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/jersey-guice-1.9.jar:/usr/hdp/current/hadoop-yarn-client/lib/jsp-api-2.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-beanutils-core-1.8.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/jersey-json-1.9.jar:/usr/hdp/current/hadoop-yarn-client/lib/gson-2.2.4.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-digester-1.8.jar:/usr/hdp/current/hadoop-yarn-client/lib/guice-servlet-3.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/aopalliance-1.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/netty-3.6.2.Final.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-logging-1.1.3.jar:/usr/hdp/current/hadoop-yarn-client/lib/log4j-1.2.17.jar:/usr/hdp/current/hadoop-yarn-client/lib/jettison-1.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-compress-1.4.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/current/hadoop-yarn-client/lib/fst-2.24.jar:/usr/hdp/current/hadoop-yarn-client/lib/guice-3.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-httpclient-3.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/jersey-core-1.9.jar:/usr/hdp/current/hadoop-yarn-client/lib/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-beanutils-1.7.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-io-2.4.jar:/usr/hdp/current/hadoop-yarn-client/lib/objenesis-2.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-collections-3.2.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/api-util-1.0.0-M20.jar:/usr/hdp/current/hadoop-yarn-client/lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hadoop-yarn-client/lib/zookeeper-3.4.6.2.3.2.0-2950.jar:/usr/hdp/current/hadoop-yarn-client/lib/jackson-core-2.2.3.jar:/usr/hdp/current/hadoop-yarn-client/lib/jaxb-api-2.2.2.jar:/usr/hdp/current/hadoop-yarn-client/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/hadoop-yarn-client/lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/current/hadoop-yarn-client/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hadoop-yarn-client/lib/curator-framework-2.7.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/jersey-client-1.9.jar:/usr/hdp/current/hadoop-yarn-client/lib/javax.inject-1.jar:/usr/hdp/current/hadoop-yarn-client/lib/asm-3.2.jar:/usr/hdp/current/hadoop-yarn-client/lib/jetty-6.1.26.hwx.jar:/usr/hdp/current/hadoop-yarn-client/lib/xz-1.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-math3-3.1.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/jsr305-3.0.0.jar:/usr/hdp/current/hadoop-yarn-client/lib/zookeeper-3.4.6.2.3.2.0-2950-tests.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-cli-1.2.jar:/usr/hdp/current/hadoop-yarn-client/lib/httpclient-4.2.5.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-lang-2.6.jar:/usr/hdp/current/hadoop-yarn-client/lib/commons-net-3.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/httpcore-4.2.5.jar:/usr/hdp/current/hadoop-yarn-client/lib/activation-1.1.jar:/usr/hdp/current/hadoop-yarn-client/lib/javassist-3.18.1-GA.jar:/usr/hdp/current/hadoop-yarn-client/lib/avro-1.7.4.jar:/usr/hdp/current/hadoop-yarn-client/lib/paranamer-2.3.jar:/usr/hdp/current/hadoop-yarn-client/lib/jsch-0.1.42.jar:/usr/hdp/current/hadoop-yarn-client/lib/stax-api-1.0-2.jar:/usr/hdp/current/hadoop-yarn-client/lib/jackson-xc-1.9.13.jar:/usr/hdp/current/hadoop-yarn-client/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/hadoop-yarn-client/lib/jets3t-0.9.0.jar:.
> 2016-08-18 12:36:05,641 WARN  util.NativeCodeLoader 
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> 2016-08-18 12:36:06,314 WARN shortcircuit.DomainSocketFactory 
> (DomainSocketFactory.java:<init>(117)) - The short-circuit local reads 
> feature cannot be used because libhadoop cannot be loaded.
> 2016-08-18 12:36:06,657 INFO  storage.DiskStorage 
> (DiskStorage.java:<init>(53)) - using 
> /grid/19/hadoop/yarn/local/usercache/mukkamula/appcache/application_1469647824867_9944/container_e46_1469647824867_9944_01_000004/tmp

> as the basepath for spooling.
> 2016-08-18 12:36:06,660 INFO  server.Server 
> (Server.java:registered(110)) - Server started listening at /0.0.0.0:57996
> 2016-08-18 12:36:07,687 INFO  engine.StreamingContainer 
> (StreamingContainer.java:heartbeatLoop(696)) - Waiting for pending 
> request.
> 2016-08-18 12:36:08,205 INFO  engine.StreamingContainer 
> (StreamingContainer.java:processHeartbeatResponse(799)) - Deploy 
> request: 
> [OperatorDeployInfo[id=6,name=silverMapper,type=GENERIC,checkpoint={ffffffffffffffff,

> 0, 
> 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=silverParserto

> silverMapper,sourceNodeId=5,sourcePortName=outputPort,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort1,streamId=silverMapper

> to silverFileOut,bufferServer=guedlpdhdp008.saifg.rbc.com]]]]
> 2016-08-18 12:36:08,537 INFO  server.Server 
> (Server.java:onMessage(463)) - Received subscriber request: 
> SubscribeRequestTuple{version=1.0, 
> identifier=tcp://guedlpdhdp008.saifg.rbc.com:57996/6.outputPort1.1, 
> windowId=ffffffffffffffff, type=silverMapper to silverFileOut/7.input, 
> upstreamIdentifier=6.outputPort1.1, mask=0, partitions=null, bufferSize=0}
> 2016-08-18 12:36:08,581 INFO  server.Server 
> (Server.java:onMessage(419)) - Received publisher request: 
> PublishRequestTuple{version=1.0, identifier=6.outputPort1.1, 
> windowId=ffffffffffffffff}
> 2016-08-18 12:36:21,926 INFO  util.AsyncFSStorageAgent 
> (AsyncFSStorageAgent.java:save(90)) - using 
> /grid/19/hadoop/yarn/local/usercache/mukkamula/appcache/application_1469647824867_9944/container_e46_1469647824867_9944_01_000004/tmp/chkp8831078126947348200as

> the basepath for checkpointing.
> 2016-08-18 12:37:19,805 ERROR netlet.AbstractLengthPrependerClient 
> (AbstractLengthPrependerClient.java:handleException(282)) - 
> Disconnecting Server.Subscriber{type=silverMapper to 
> silverFileOut/7.input, mask=0, partitions=null} because of an exception.
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
>         at 
> com.datatorrent.netlet.AbstractClient.read(AbstractClient.java:166)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.handleSelectedKey(DefaultEventLoop.java:364)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop$SelectedSelectionKeySet.forEach(OptimizedEventLoop.java:59)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:192)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:157)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.run(DefaultEventLoop.java:156)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-08-18 12:37:19,810 WARN  netlet.OptimizedEventLoop 
> (OptimizedEventLoop.java:forEach(65)) - Exception on unattached 
> SelectionKey sun.nio.ch.SelectionKeyImpl@6cf27734
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51)
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:492)
>         at 
> com.datatorrent.netlet.AbstractClient.write(AbstractClient.java:274)
>         at 
> com.datatorrent.netlet.Listener$DisconnectingListener.write(Listener.java:241)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.handleSelectedKey(DefaultEventLoop.java:365)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop$SelectedSelectionKeySet.forEach(OptimizedEventLoop.java:59)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:192)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:157)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.run(DefaultEventLoop.java:156)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-08-18 12:37:27,197 INFO  server.Server 
> (Server.java:onMessage(463)) - Received subscriber request: 
> SubscribeRequestTuple{version=1.0, 
> identifier=tcp://guedlpdhdp008.saifg.rbc.com:57996/6.outputPort1.1, 
> windowId=ffffffffffffffff, type=silverMapper to silverFileOut/7.input, 
> upstreamIdentifier=6.outputPort1.1, mask=0, partitions=null, bufferSize=0}
> 2016-08-18 12:38:29,970 ERROR netlet.AbstractLengthPrependerClient 
> (AbstractLengthPrependerClient.java:handleException(282)) - 
> Disconnecting Server.Subscriber{type=silverMapper to 
> silverFileOut/7.input, mask=0, partitions=null} because of an exception.
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
>         at 
> com.datatorrent.netlet.AbstractClient.read(AbstractClient.java:166)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.handleSelectedKey(DefaultEventLoop.java:364)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop$SelectedSelectionKeySet.forEach(OptimizedEventLoop.java:59)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:192)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:157)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.run(DefaultEventLoop.java:156)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-08-18 12:38:29,971 WARN  netlet.OptimizedEventLoop 
> (OptimizedEventLoop.java:forEach(65)) - Exception on unattached 
> SelectionKey sun.nio.ch.SelectionKeyImpl@6b8716b6
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51)
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:492)
>         at 
> com.datatorrent.netlet.AbstractClient.write(AbstractClient.java:274)
>         at 
> com.datatorrent.netlet.Listener$DisconnectingListener.write(Listener.java:241)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.handleSelectedKey(DefaultEventLoop.java:365)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop$SelectedSelectionKeySet.forEach(OptimizedEventLoop.java:59)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:192)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:157)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.run(DefaultEventLoop.java:156)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-08-18 12:38:37,370 INFO  server.Server 
> (Server.java:onMessage(463)) - Received subscriber request: 
> SubscribeRequestTuple{version=1.0, 
> identifier=tcp://guedlpdhdp008.saifg.rbc.com:57996/6.outputPort1.1, 
> windowId=ffffffffffffffff, type=silverMapper to silverFileOut/7.input, 
> upstreamIdentifier=6.outputPort1.1, mask=0, partitions=null, bufferSize=0}
> 2016-08-18 12:39:40,113 ERROR netlet.AbstractLengthPrependerClient 
> (AbstractLengthPrependerClient.java:handleException(282)) - 
> Disconnecting Server.Subscriber{type=silverMapper to 
> silverFileOut/7.input, mask=0, partitions=null} because of an exception.
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
>         at 
> com.datatorrent.netlet.AbstractClient.read(AbstractClient.java:166)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.handleSelectedKey(DefaultEventLoop.java:364)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop$SelectedSelectionKeySet.forEach(OptimizedEventLoop.java:59)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:192)
>         at 
> com.datatorrent.netlet.OptimizedEventLoop.runEventLoop(OptimizedEventLoop.java:157)
>         at 
> com.datatorrent.netlet.DefaultEventLoop.run(DefaultEventLoop.java:156)
>         at java.lang.Thread.run(Thread.java:745)
> Regards,
> Surya Vamshi
>
> _______________________________________________________________________
>
> If you received this email in error, please advise the sender (by 
> return email or otherwise) immediately. You have consented to receive 
> the attached electronically at the above-noted email address; please 
> retain a copy of this confirmation for future reference.
>
> Si vous recevez ce courriel par erreur, veuillez en aviser 
> l'expéditeur immédiatement, par retour de courriel ou par un autre 
> moyen. Vous avez accepté de recevoir le(s) document(s) ci-joint(s) par 
> voie électronique à l'adresse courriel indiquée ci-dessus; veuillez 
> conserver une copie de cette confirmation pour les fins de reference 
> future.
>


Mime
View raw message