Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@oodt.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: "Mattmann, Chris A (388J)" <chris.a.mattmann@jpl.nasa.gov>
To: YunHee Kang <yunh.kang@gmail.com>
CC: Brian Foster <holenoter@mac.com>,
        "<dev@oodt.apache.org>"
	<dev@oodt.apache.org>,
        "<user@oodt.apache.org>" <user@oodt.apache.org>
Subject: Re: The problem occurred when downloading a file by using a
 protocol "sftp" in pushpull
Thread-Topic: The problem occurred when downloading a file by using a
 protocol "sftp" in pushpull
Thread-Index: AQHNc5Q/jqr06EZ2KE61IuAtGhbYmZdM6PcAgABxQAA=
Date: Mon, 6 Aug 2012 15:11:07 +0000
Message-ID: <49A9EDF6-D2F9-475B-AEFD-82AB89625E8F@jpl.nasa.gov>
References: 
 <CAH=8jECDx4a2xO5dc83Qe49To9zOLWehZ+FU1rSpuvL6AHzO2g@mail.gmail.com>
 <CAH=8jECtObWAy_+Na7OJf0WyoycyvHCghs45YEFsistG9U8fQg@mail.gmail.com>
In-Reply-To: 
 <CAH=8jECtObWAy_+Na7OJf0WyoycyvHCghs45YEFsistG9U8fQg@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-ID: <DD7D40EE35558A408ACBF41C1ED5AAF2@ad.jpl>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi YunHee,

Great job. Can you please file a JIRA issue for this and upload
a patch file?

Thank you!

Cheers,
Chris

On Aug 6, 2012, at 1:28 AM, YunHee Kang wrote:

> Hi Brian,
>=20
> I just have fixed  the problem I had related with sftp protocol in
> pushpull framework.
> To fix it, I just added the following statement in the method
> connect() in the file JschSftpProtocol.java.
> session.setConfig("StrictHostKeyChecking", "no");
>=20
> You can get more details about the above statement  in the following:
> http://www.mail-archive.com/jsch-users@lists.sourceforge.net/msg00393.htm=
l
>=20
> Thanks,
> Yunhee
>=20
>=20
>=20
>=20
> 2012/8/6 YunHee Kang <yunh.kang@gmail.com>:
>> Hi Brian,
>>=20
>> I tried to download a file with sftp protocol in pushpull framework
>> and got two warnings and a severe error message as follows:
>> WARNING: Error occurred while connecting to RemoteSite: alias =3D
>> 'SCPTESL2CO2'  url =3D 'sftp://agent.bu.ac.kr'  username =3D 'yhkang'
>> cdTestDir =3D 'null' maxConnections =3D '-1' : Failed to connect to host
>> agent.bu.ac.kr : reject HostKey: agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>> getAppropriateProtocolBySite
>> WARNING: ProtocolFactory
>> org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory is not
>> compatible with server at sftp://agent.bu.ac.kr
>> Aug 6, 2012 2:13:48 PM
>> org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup
>> retrieveFiles
>> SEVERE: Failed to finish downloading per property files
>> /home/yhkang/oodt-0.5/cas-pushpull/etc/examples/DirStructXmlParserFiles/=
SCPTESL2CO2.xml
>> : Failed to get appropriate protocol for RemoteSite: alias =3D
>> 'SCPTESL2CO2'  url =3D 'sftp://agent.bu.ac.kr'  username =3D 'yhkang'
>> cdTestDir =3D 'null' maxConnections =3D '-1'
>> org.apache.oodt.cas.protocol.exceptions.ProtocolException: Failed to
>> get appropriate protocol for RemoteSite: alias =3D 'SCPTESL2CO2'  url =
=3D
>> 'sftp://agent.bu.ac.kr'  username =3D 'yhkang' cdTestDir =3D 'null'
>> maxConnections =3D '-1'
>>        at org.apache.oodt.cas.pushpull.protocol.ProtocolHandler.getAppro=
priateProtocolBySite(ProtocolHandler.java:166)
>>        at org.apache.oodt.cas.pushpull.retrievalsystem.FileRetrievalSyst=
em.changeToDir(FileRetrievalSystem.java:304)
>>        at org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler.pro=
cessPropFile(RemoteCrawler.java:104)
>>        at org.apache.oodt.cas.pushpull.retrievalsystem.RetrievalSetup.re=
trieveFiles(RetrievalSetup.java:109)
>>        at org.apache.oodt.cas.pushpull.daemon.Daemon$1.run(Daemon.java:2=
18)
>>        at java.lang.Thread.run(Thread.java:662)
>> Aug 6, 2012 2:13:48 PM org.apache.oodt.cas.pushpull.daemon.Daemon$1 run
>> INFO: Daemon with ID =3D 90121 on RMI registry port 9012 is shutting dow=
n
>>=20
>> I think the warning message is related with an exception occurred in
>> the method  connect() of  JschSftpClient.java:
>> protected void connect(String host, final String username,
>>      final String password) throws ProtocolException {
>>    try {
>>      System.out.println(System.getProperty("user.home") + "/.ssh/known_h=
osts");
>>      jsch.setKnownHosts(System.getProperty("user.home") + "/.ssh/known_h=
osts");
>>      session =3D jsch.getSession(username, this.getRemoteSite().getURL()
>>          .getHost(), 22);
>>      session.setPassword(password);
>>      session.connect();
>>      sftpChannel =3D (ChannelSftp) session.openChannel("sftp");
>>      sftpChannel.connect();
>>    } catch (Exception e) {
>>      throw new ProtocolException("Failed to connect to host " + host + "=
 : "
>>          + e.getMessage());
>>    }
>>  }
>>=20
>> I make sure that there is no problem  when downloading  a file by  scp
>> command  without any password as follows:
>> scp yhkang@agent.bu.ac.kr://home/yhkang/oodt-0.5/TL2CO2N.005/2004.09.20/=
TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5
>> .
>> TES-Aura_L2-CO2-Nadir_r0000002147_F06_09.he5  100%   88MB  87.9MB/s   00=
:01
>>=20
>> Let me know how to fix the problem.
>>=20
>> Thanks,
>> Yunhee


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++