oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: PushPull Question....
Date Wed, 28 Dec 2011 23:35:21 GMT
Hey Bfost, yep I just pushed it over to Apache Extras now. Do you want me to give you admin
access
to that SVN project? At Apache Extras, we can host closely related Apache projects that have
incompatible
licenses, see here:

http://community.apache.org/apache-extras/faq.html

Cheers,
Chris

On Dec 28, 2011, at 2:59 PM, holenoter wrote:

> i believe i did this integration for peate before i left... there is a peate-pushpull
which depends on cas-pushpull and adds the non-apache protocols... also can you send me your
tar.gz of the pushpull you are currently using... and i will see if i can figure out what
is going on.
> 
> -brian
> 
> On Dec 28, 2011, at 02:16 PM, "Mattmann, Chris A (388J)" <chris.a.mattmann@jpl.nasa.gov>
wrote:
> 
>> Hey Cam,
>> 
>> On Dec 27, 2011, at 8:48 PM, Cameron Goodale wrote:
>> 
>> > Brian,
>> > 
>> > Thanks for the info. I don't have my eclipse setup properly to run that
>> > java file as an application so I will have to try that with some help from
>> > Paul or Chris next week perhaps. 
>> 
>> The best way to run it would be to:
>> 
>> 1. cd /usr/local/pushpull
>> 2. java -Djava.ext.dirs=lib org.apache.oodt.cas.pushpull.util.ExpressionValidator
>> 
>> > I looked up the regex for Java and the \w
>> > is supposed to be a word character matching alphanumeric and underscore.
>> > 
>> > I ran my regex against this online tool I found and it seems to be a valid
>> > match.
>> > http://www.regexplanet.com/advanced/java/index.html
>> > Regex: TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
>> > 
>> > Input: TES-Aura_L2-CO2-Nadir_r0000002931_F06_08.he5
>> > 
>> > 
>> > Thanks for the feedback and help on this. I have tried so many different
>> > tweaks with backslashes, etc. I am going to just walk away now and look at
>> > it later.
>> 
>> I think it's a protocol issue. Let me see if I can throw up those LGPL plugins 
>> somewhere b/c we can't host them at Apache. Or better yet, if folks have a
>> better ALv2 compatible FTP library, I'll happily write a PushPull plugin and 
>> integrate it. 
>> 
>> Cheers,
>> Chris
>> 
>> 
>> > 
>> > 
>> > -Cam
>> > 
>> > 
>> > On Tue, Dec 27, 2011 at 2:58 PM, Brian Foster <holenoter@me.com> wrote:
>> > 
>> >> Hey cameron.. I think the problem is with ur
>> >> DirStructXmlParserFiles/TESL2CO2.xml file... for the file name regExp u
are
>> >> specifying whitespace (i.e. \w instead of underscore)... pushpull looks
>> >> like it is behaving normally... it is acting like it is not finding any
>> >> files that match ur regExps... I wrote an app which may help u with your
>> >> regular expressions... in the pushpull util package in eclipse right click
>> >> on ExpressionValidator.java and Run As: Java Application... you can test
>> >> your regExp in the GUI that pops up.
>> >> 
>> >> -brian
>> >> 
>> >> Cameron Goodale <goodale@apache.org> wrote:
>> >> 
>> >>> Hey Devs,
>> >>> 
>> >>> I have been working on building an OODT PushPull User Guide from an
>> >> Example
>> >>> I am trying to get working for a project, and I have encountered a little
>> >>> issue (at least I hope it is little).
>> >>> 
>> >>> Here is the guide (work in progress):
>> >>> 
>> >> https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide
>> >>> 
>> >>> The setups listed in the User Guide are the same ones I am working
>> >> against.
>> >>> Now here is the log messages I am seeing.
>> >>> 
>> >>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.daemon.DaemonManager
>> >>> setAsRunning
>> >>> INFO: Daemon with ID = 91131 was given permission to run
>> >>> org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser
>> >>> Dec 27, 2011 10:59:00 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>> >>> INFO: Testing protocol
>> >>> org.apache.oodtcas.pushpull.protocol.ftp.CogJGlobusFtpClient . . . this
>> >>> may take a few minutes . . .
>> >>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>> >>> cdToHOME
>> >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>> >>> Dec 27, 2011 10:59:00 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>> >>> SEVERE: Protocol
>> >>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient failed
>> >>> compatibility test : [CogJGlobusFtpClient] Failed to get list of files
:
>> >>> Server refused performing the request. Custom message: (error code 1)
>> >>> [Nested exception message: Custom message: Unexpected reply: 500 'ORT
>> >>> 97,93,139,127,210,161': command not understood.]
>> >>> Dec 27, 2011 10:59:00 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>> >>> getAppropriateProtocolBySite
>> >>> WARNING: ProtocolFactory
>> >>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory
is
>> >> not
>> >>> compatible with server at ftp://l4ftl01.larc.nasa.gov
>> >>> Dec 27, 2011 10:59:01 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>> >>> INFO: Testing protocol
>> >>> org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient . . .
this
>> >>> may take a few minutes . . .
>> >>> Dec 27, 2011 10:59:01 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>> >>> cdToHOME
>> >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>> >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>> >>> cdToROOT
>> >>> INFO: Changing to ROOT directory '/'
>> >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>> >>> cdToHOME
>> >>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>> >>> Dec 27, 2011 10:59:02 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler connect
>> >>> INFO: Successfully connected to ftp://l4ftl01.larc.nasa.gov with protocol
>> >>> 'org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient' and
>> >>> username 'anonymous'
>> >>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
cd
>> >>> INFO: Changing to directory
>> >>> 'ftp://l4ftl01.larc.nasa.gov/TES/TL2CO2N.005isDir=true'
>> >>> PageSize: 8 PageLoc: 0
>> >>> FileList size: 491
>> >>> Dec 27, 2011 10:59:03 AM
>> >>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler disconnect
>> >>> INFO: Disconnecting protocol from ftp://l4ftl01.larc.nasa.gov
>> >>> Dec 27, 2011 10:59:03 AM org.apache.oodt.cas.pushpull.daemon.Daemon
sleep
>> >>> INFO: Daemon with ID = 91131 on RMI registry port 9113 is going to sleep
>> >>> until Tue Dec 27 11:00:00 PST 2011
>> >>> 
>> >>> 
>> >>> First PushPull tries to use the CogJGlobusFtpClient and it encounters
an
>> >>> error so it switches to CommonsNetFtpClient does a couple cd commands,
>> >>> connects successfully then disconnects and goes back to sleep. It will
>> >>> then wake up after the 3 minutes and repeat the same process. Has anyone
>> >>> seen this issue or have any suggestions for a fix?
>> >>> 
>> >>> Thank you in advance.
>> >>> 
>> >>> -Cameron
>> >>> 
>> >>> P.S. If you have any feedback on the PushPull User Guide be sure to
leave
>> >>> comments or make changes to the wiki.
>> >> 
>> 
>> 
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW: http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> 


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message