commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Seganti, Michael (DOF)" <Segan...@finance.nyc.gov>
Subject [net] FTPClient Transfer succeeds but fails in cleanUp
Date Thu, 17 Nov 2016 17:19:08 GMT
I'm having a sporadic issue transferring files to a Mainframe, was wondering if anyone else
has run into this.  I'm trying to figure out if this is a Mainframe issue, or a net commons
issue.

I'm using Java 1.7 and commons-net-3.3.jar

The file transfer completes, but it looks like either the 200 OK is sent over the wrong connection,
or is not properly being parsed and is causing the cleanup to fail.

According to the reply: IBM FTP CS V2R2 is the version where the issue occurs.

I have a second mainframe that is running IBM FTP CS V1R13 that doesn't seem to have this
issue

In a normal transfer, you would see:

250 Transfer completed successfully.
       File Transfer Completed Successfully at: 2016-11-17 04:30:51.569
QUIT
221 Quit command received. Goodbye.

This is what we are getting on the failures:

250 Transfer completed successfully.
200 OK

       File Transfer Failed at: 2016-11-17 04:36:50.246
Error Occurred Transmitting File to Remote System, aborting...

Read timed out

Here's the full log from the failed transfer:

Using FTPS Connection with Protocol: TLS and Explicit Security Request
220-FTPSECR1 IBM FTP CS V2R2 at MVSP.XXX, 09:27:29 on 2016-11-17.
220 Connection will close if idle for more than 5 minutes.
AUTH TLS
234 Security environment established - ready for negotiation
Connected to mvsp.xxx on xxxx
PBSZ 0
200 Protection buffer size accepted
PROT P
200 Data connection protection set to private
USER *******
331 Send password please.
PASS *******
230 C836PTS is logged on.  Working directory is "C836PTS.".
PWD
257 "'C836PTS.'" is working directory.

Using a Packet Size of: 4096
Control KeepAliveTimeOut: 60
Control KeepAliveReplyTimeOut: 5000
FEAT
211- Extensions supported
AUTH TLS
PBSZ
PROT
211 End

...FTPClientUtil Connected Successfully!
SITE TRAIL
200 SITE command was accepted
SITE CYLINDERS PRIMARY=2100 SECONDARY=250
200 SITE command was accepted
SITE RECFM=FB LRECL=1915 BLKSIZE=30640
200 SITE command was accepted
SITE CONDDISP=delete
200 SITE command was accepted


Sending:
                Local: d:\LargeExtracts\full.txt
                Remote: 'A836.ORG.CAMA2.FULL'
                Starting at: 2016-11-17 09:27:34.798
Total Bytes To Send: 2101359588
PASV
227 Entering Passive Mode (xx,xx,x,xx,xx,xx)
STOR 'A836.ORG.CAMA2.FULL'
125 Storing data set A836.ORG.CAMA2.FULL
2016-11-17 09:27:47.721 - 5 Percent Complete, Total Bytes Transferred: 105070592
2016-11-17 09:28:01.190 - 10 Percent Complete, Total Bytes Transferred: 210137088
...
2016-11-17 09:32:21.127 - 100 Percent Complete, Total Bytes Transferred: 2101359588
250 Transfer completed successfully.
200 OK

                File Transfer Failed at: 2016-11-17 09:32:26.127
Error Occurred Transmitting File to Remote System, aborting...

Read timed out
java.net.SocketTimeoutException: Read timed out
                at java.net.SocketInputStream.socketRead0(Native Method)
                at java.net.SocketInputStream.read(Unknown Source)
                at java.net.SocketInputStream.read(Unknown Source)
                at sun.security.ssl.InputRecord.readFully(Unknown Source)
                at sun.security.ssl.InputRecord.read(Unknown Source)
                at sun.security.ssl.SSLSocketImpl.readRecord(Unknown Source)
                at sun.security.ssl.SSLSocketImpl.readDataRecord(Unknown Source)
                at sun.security.ssl.AppInputStream.read(Unknown Source)
                at sun.nio.cs.StreamDecoder.readBytes(Unknown Source)
                at sun.nio.cs.StreamDecoder.implRead(Unknown Source)
                at sun.nio.cs.StreamDecoder.read(Unknown Source)
                at java.io.InputStreamReader.read(Unknown Source)
                at java.io.BufferedReader.fill(Unknown Source)
                at java.io.BufferedReader.readLine(Unknown Source)
                at java.io.BufferedReader.readLine(Unknown Source)
                at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:314)
                at org.apache.commons.net.ftp.FTP.__getReplyNoReport(FTP.java:304)
                at org.apache.commons.net.ftp.FTPClient$CSL.cleanUp(FTPClient.java:3697)
                at org.apache.commons.net.ftp.FTPClient._storeFile(FTPClient.java:669)
                at org.apache.commons.net.ftp.FTPClient.__storeFile(FTPClient.java:624)
                at org.apache.commons.net.ftp.FTPClient.storeFile(FTPClient.java:1976)
                at gov.nyc.ftputils.FTPConnection.sendFile(FTPConnection.java:695)
                at gov.nyc.ftputils.FTPPropertyProcessor.putFile(FTPPropertyProcessor.java:54)
                at gov.nyc.ftputils.FTPPropertyProcessor.putFile(FTPPropertyProcessor.java:96)
                at gov.nyc.ftputils.FTPPropertyProcessor.processFileProps(FTPPropertyProcessor.java:126)
                at gov.nyc.ftputils.FTPClientUtil.main(FTPClientUtil.java:378)
FTPClientUtil has Failed
QUIT
221 Quit command received. Goodbye.


Here's a code snippet of the transfer code:

try{
            if (trace){
                                                System.out.println("Total Bytes To Send: "
+ localFile.length());
                                                CopyStreamListener listener = new ProgressStreamListener(localFile.length());
                                                ftp.setCopyStreamListener(listener);
                                }

                InputStream input = new FileInputStream(localFileName);
                boolean result = ftp.storeFile(tempRemoteFileName, input);
                input.close();

                if (result){
                                System.out.println("\tFile Transfer Completed Successfully
at: " + sdf.format(Calendar.getInstance().getTime()));
                                ...
                }
                else
                                System.out.println("\tFile Transfer Failed at: " + sdf.format(Calendar.getInstance().getTime()));

                return result;
}catch (CopyStreamException cse){
                System.err.println("\n\tFile Transfer Failed at: " + sdf.format(Calendar.getInstance().getTime())
+ ", Failure occurred after " + cse.getTotalBytesTransferred() + " Bytes Transferred");
                System.err.println("Error Occurred Transmitting File to Remote System, aborting...\n");
                cse.printStackTrace(System.err);
                System.err.println("\n\nIOException Stack Trace that Caused the Error:\n");
                cse.getIOException().printStackTrace(System.err);
                return false;
}catch (IOException ioe){
System.err.println("\n\tFile Transfer Failed at: " + sdf.format(Calendar.getInstance().getTime()));
                System.err.println("Error Occurred Transmitting File to Remote System, aborting...\n");
                System.err.println(ioe.getMessage());
                ioe.printStackTrace(System.err);
                return false;
}catch (Exception e){
                System.err.println("\n\tFile Transfer Failed at: " + sdf.format(Calendar.getInstance().getTime()));
                System.err.println("Error Occurred Transmitting File to Remote System, aborting...\n");
                e.printStackTrace(System.err);
                return false;
}
}


Thanks,

Mike...

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message