Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F31F5DF7B for ; Mon, 6 Aug 2012 05:28:31 +0000 (UTC) Received: (qmail 89829 invoked by uid 500); 6 Aug 2012 05:28:31 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 89709 invoked by uid 500); 6 Aug 2012 05:28:29 -0000 Mailing-List: contact user-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@oodt.apache.org Delivered-To: mailing list user@oodt.apache.org Received: (qmail 89674 invoked by uid 99); 6 Aug 2012 05:28:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Aug 2012 05:28:28 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yunh.kang@gmail.com designates 209.85.214.171 as permitted sender) Received: from [209.85.214.171] (HELO mail-ob0-f171.google.com) (209.85.214.171) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Aug 2012 05:28:20 +0000 Received: by obqv19 with SMTP id v19so12695014obq.16 for ; Sun, 05 Aug 2012 22:27:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=60R+2djPTS8ipC4/+lW2Vm8/kPYaghLJsZt18+pTAX4=; b=qCbrPCxaXRoRJN6S9EdUJXL7VqjIyHxUK2z7i+94PKLU6yADDbFxXqFQ+ogiNH9ncl JiasU2YZ0Kw81U61O9nblWVoKsa+KmEEW2STE7z1Ehfg0r8G7JwBPBY//QzHVl5Okb6p X2E5cJaDxJdYvCO4P6l3S9smYk1Dc82eCv0sv/qrvadb4CTQSONwPGI8vR/z7U+0NBtB Hf2x5bKYIEVk5UGg3E7jbSOONs9g1omUQDaTagxLC7NNFs2Kp6f8n+WiLm+KvW7AazD4 u+5FU1GqzRP7aFcqHyiyDI5RgNrFT5H70p0ive6Iwo1udb5ZFIKijmvnJpMOXV1A4IDC cISg== MIME-Version: 1.0 Received: by 10.182.73.65 with SMTP id j1mr17553598obv.42.1344230879685; Sun, 05 Aug 2012 22:27:59 -0700 (PDT) Received: by 10.182.118.99 with HTTP; Sun, 5 Aug 2012 22:27:59 -0700 (PDT) Date: Mon, 6 Aug 2012 15:27:59 +1000 Message-ID: Subject: The problem occurred when downloading a file by using a protocol "sftp" in pushpull From: YunHee Kang To: Brian Foster Cc: user@oodt.apache.org, "Mattmann, Chris A (388J)" Content-Type: text/plain; charset=ISO-8859-1 Hi Brian, I tried to download a file with sftp protocol in pushpull framework and got two warnings and a severe error message as follows: WARNING: Error occurred while connecting to RemoteSite: alias = 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.protocol.ProtocolHandler getAppropriateProtocolBySite WARNING: ProtocolFactory org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not compatible with server at sftp://agent.bu.ac.kr Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup retrieveFiles SEVERE: Failed to finish downloading per property files /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml : Failed to get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null' maxConnections = '-1' org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null' maxConnections = '-1' at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166) at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304) at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104) at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109) at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218) at java.lang.Thread.run(Thread.java:662) Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down I think the warning message is related with an exception occurred in the method connect() of JschSftpClient.java: protected void connect(String host, final String username, final String password) throws ProtocolException { try { System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts"); jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts"); session = jsch.getSession(username, this.getRemoteSite().getURL() .getHost(), 22); session.setPassword(password); session.connect(); sftpChannel = (ChannelSftp) session.openChannel("sftp"); sftpChannel.connect(); } catch (Exception e) { throw new ProtocolException("Failed to connect to host " + host + " : " + e.getMessage()); } } I make sure that there is no problem when downloading a file by scp command without any password as follows: scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 . TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01 Let me know how to fix the problem. Thanks, Yunhee