Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7562FD196 for ; Mon, 6 Aug 2012 17:41:42 +0000 (UTC) Received: (qmail 82856 invoked by uid 500); 6 Aug 2012 17:41:42 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 82807 invoked by uid 500); 6 Aug 2012 17:41:42 -0000 Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@oodt.apache.org Delivered-To: mailing list dev@oodt.apache.org Received: (qmail 82788 invoked by uid 99); 6 Aug 2012 17:41:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Aug 2012 17:41:42 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of holenoter@mac.com designates 17.172.220.239 as permitted sender) Received: from [17.172.220.239] (HELO st11p02mm-asmtpout004.mac.com) (17.172.220.239) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Aug 2012 17:41:35 +0000 MIME-version: 1.0 Content-type: multipart/alternative; boundary="Boundary_(ID_BQOFZGj4ANq5vvz6WVjZfA)" Received: from st11p02mm-spool002.mac.com ([17.172.220.247]) by st11p02mm-asmtp004.mac.com (Oracle Communications Messaging Server 7u4-24.01(7.0.4.24.0) 64bit (built Jan 3 2012)) with ESMTP id <0M8C00MVMH42MP70@st11p02mm-asmtp004.mac.com>; Mon, 06 Aug 2012 17:41:09 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.7.7855,1.0.260,0.0.0000 definitions=2012-08-06_04:2012-08-06,2012-08-06,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 suspectscore=0 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=6.0.2-1203120001 definitions=main-1208060185 Received: from localhost ([17.172.220.222]) by st11p02mm-spool002.mac.com (Oracle Communications Messaging Server 7u4-23.01(7.0.4.23.0) 64bit (built Aug 10 2011)) with ESMTP id <0M8C00CIMH4INDA0@st11p02mm-spool002.mac.com>; Mon, 06 Aug 2012 17:41:06 +0000 (GMT) To: YunHee Kang Cc: "" , "Mattmann, Chris A (388J)" , user@oodt.apache.org From: Brian Foster Subject: Re: The problem occurred when downloading a file by using a protocol "sftp" in pushpull Date: Mon, 06 Aug 2012 17:41:06 +0000 (GMT) X-Mailer: iCloud Mail (1K43+9339) X-Originating-IP: [74.125.59.129] Message-id: In-reply-to: X-Virus-Checked: Checked by ClamAV on apache.org --Boundary_(ID_BQOFZGj4ANq5vvz6WVjZfA) Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT hey yunhee and chris, we DON'T want to turn that off!... you need to connect to the site either using command-line sftp or something similar so you can accept adding the sftp site to your known hosts file... sftp protocol is working correctly -brian On Aug 06, 2012, at 01:28 AM, YunHee Kang wrote: Hi Brian, I just have fixed the problem I had related with sftp protocol in pushpull framework. To fix it, I just added the following statement in the method connect() in the file JschSftpProtocol.java. session.setConfig("StrictHostKeyChecking", "no"); You can get more details about the above statement in the following: jsch-users@lists.sourceforge.net/msg00393.html'>http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.html Thanks, Yunhee 2012/8/6 YunHee Kang : > Hi Brian, > > I tried to download a file with sftp protocol in pushpull framework > and got two warnings and a severe error message as follows: > WARNING: Error occurred while connecting to RemoteSite: alias = > 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang' > cdTestDir = 'null' maxConnections = '-1' : Failed to connect to host > agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr > Aug 6, 2012 2:13:48 PM > org.apache.oodt.cas.pushpull.protocol.ProtocolHandler > getAppropriateProtocolBySite > WARNING: ProtocolFactory > org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not > compatible with server at sftp://agent.bu.ac.kr > Aug 6, 2012 2:13:48 PM > org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup > retrieveFiles > SEVERE: Failed to finish downloading per property files > /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.xml > : Failed to get appropriate protocol for RemoteSite: alias = > 'SCPTESL2CO2' url = 'sftp://agent.bu.ac.kr' username = 'yhkang' > cdTestDir = 'null' maxConnections = '-1' > org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to > get appropriate protocol for RemoteSite: alias = 'SCPTESL2CO2' url = > 'sftp://agent.bu.ac.kr' username = 'yhkang' cdTestDir = 'null' > maxConnections = '-1' > at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandler.java:166) > at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSystem.changeToDir(FileRetrievalSystem.java:304) > at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(RemoteCrawler.java:104) > at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109) > at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218) > at java.lang.Thread.run(Thread.java:662) > Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run > INFO: Daemon with ID = 90121 on RMI registry port 9012 is shutting down > > I think the warning message is related with an exception occurred in > the method connect() of JschSftpClient.java: > protected void connect(String host, final String username, > final String password) throws ProtocolException { > try { > System.out.println(System.getProperty("user.home") + "/.ssh/known_hosts"); > jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_hosts"); > session = jsch.getSession(username, this.getRemoteSite().getURL() > .getHost(), 22); > session.setPassword(password); > session.connect(); > sftpChannel = (ChannelSftp) session.openChannel("sftp"); > sftpChannel.connect(); > } catch (Exception e) { > throw new ProtocolException("Failed to connect to host " + host + " : " > + e.getMessage()); > } > } > > I make sure that there is no problem when downloading a file by scp > command without any password as follows: > scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 > . > TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01 > > Let me know how to fix the problem. > > Thanks, > Yunhee --Boundary_(ID_BQOFZGj4ANq5vvz6WVjZfA) Content-type: multipart/related; boundary="Boundary_(ID_zFuZPZK5+mR4cno4e2QiQg)"; type="text/html" --Boundary_(ID_zFuZPZK5+mR4cno4e2QiQg) Content-type: text/html; CHARSET=US-ASCII Content-transfer-encoding: quoted-printable
hey yunhee and chris,

we DON'T want to turn = that off!... you need to connect to the site either using command-line sft= p or something similar so you can accept adding the sftp site to your know= n hosts file... sftp protocol is working correctly

-brian

On Aug 06, 2012, at 01:28 AM, YunHee Kang <yunh.kang@gm= ail.com> wrote:

Hi Brian,

I just have fixed t= he problem I had related with sftp protocol in
pushpull framework.
= To fix it, I just added the following statement in the method
connect= () in the file JschSftpProtocol.java.
session.setConfig("StrictHostKey= Checking", "no");

You can get more details about the above statem= ent in the following:
jsch-use= rs@lists.sourceforge.net/msg00393.html'>http://www.mail-archive.com= /jsch-users@lists.sourceforge.net/= msg00393.html

Thanks,
Yunhee




2012/8/6= YunHee Kang <yunh.kang@gmail.com>:
> Hi Brian,=
>
> I tried to download a file with sftp protocol in pushpu= ll framework
> and got two warnings and a severe error message as f= ollows:
> WARNING: Error occurred while connecting to RemoteSite: a= lias =3D
> 'SCPTESL2CO2' url =3D 'sftp://agent.bu.ac.kr' userna= me =3D 'yhkang'
> cdTestDir =3D 'null' maxConnections =3D '-1' : Fa= iled to connect to host
> agent.bu.ac.kr : reject HostKey: agent.bu= .ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.pushpu= ll.protocol.ProtocolHandler
> getAppropriateProtocolBySite
>= WARNING: ProtocolFactory
> org.apache.oodt.cas.protocol.sftp.JschS= ftpProtocolFactory is not
> compatible with server at sftp://agent.= bu.ac.kr
> Aug 6, 2012 2:13:48 PM
> org.apache.oodt.cas.= pushpull.retrievalsystem.RetrievalSetup
> retrieveFiles
> SE= VERE: Failed to finish downloading per property files
> /home/yhkan= g/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/SCPTESL2CO2.x= ml
> : Failed to get appropriate protocol for RemoteSite: alias =3D=
> 'SCPTESL2CO2' url =3D 'sftp://agent.bu.ac.kr' username =3D '= yhkang'
> cdTestDir =3D 'null' maxConnections =3D '-1'
> org= .apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>= get appropriate protocol for RemoteSite: alias =3D 'SCPTESL2CO2' url =3D<= br> > 'sftp://agent.bu.ac.kr' username =3D 'yhkang' cdTestDir =3D '= null'
> maxConnections =3D '-1'
> at org.apache.oodt.cas.pus= hpull.protocol.ProtocolHandler.getAppropriateProtocolBySite(ProtocolHandle= r.java:166)
> at org.apache.oodt.cas.pushpull.retrievalsystem.FileR= etrievalSystem.changeToDir(FileRetrievalSystem.java:304)
> at org.a= pache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.processPropFile(Remo= teCrawler.java:104)
> at org.apache.oodt.cas.pushpull.retrievalsyst= em.RetrievalSetup.retrieveFiles(RetrievalSetup.java:109)
> at org.a= pache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:218)
> at j= ava.lang.Thread.run(Thread.java:662)
> Aug 6, 2012 2:13:48 PM org.a= pache.oodt.cas.pushpull.daemon.Daemon$1 run
> INFO: Daemon with ID = =3D 90121 on RMI registry port 9012 is shutting down
>
> I t= hink the warning message is related with an exception occurred in
>= the method connect() of JschSftpClient.java:
> protected void conn= ect(String host, final String username,
> final String password) th= rows ProtocolException {
> try {
> System.out.println(System= .getProperty("user.home") + "/.ssh/known_hosts");
> jsch.setKnownHo= sts(System.getProperty("user.home") + "/.ssh/known_hosts");
> sessi= on =3D jsch.getSession(username, this.getRemoteSite().getURL()
> .g= etHost(), 22);
> session.setPassword(password);
> session.co= nnect();
> sftpChannel =3D (ChannelSftp) session.openChannel("sftp"= );
> sftpChannel.connect();
> } catch (Exception e) {
&g= t; throw new ProtocolException("Failed to connect to host " + host + " : "=
> + e.getMessage());
> }
> }
>
> I mak= e sure that there is no problem when downloading a file by scp
> co= mmand without any password as follows:
> scp yhkang@agent.b= u.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/TES-Aura_L2-C= O2-Nadir_r0000002147_F06_09.he5
> .
> TES-Aura_L2-CO2-Na= dir_r0000002147_F06_09.he5 100% 88MB 87.9MB/s 00:01
>
> Let = me know how to fix the problem.
>
> Thanks,
> Yunhee<= br>
= --Boundary_(ID_zFuZPZK5+mR4cno4e2QiQg)-- --Boundary_(ID_BQOFZGj4ANq5vvz6WVjZfA)--