oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: PushPull Question....
Date Wed, 28 Dec 2011 22:16:02 GMT
Hey Cam,

On Dec 27, 2011, at 8:48 PM, Cameron Goodale wrote:

> Brian,
> 
> Thanks for the info.  I don't have my eclipse setup properly to run that
> java file as an application so I will have to try that with some help from
> Paul or Chris next week perhaps.  

The best way to run it would be to:

1. cd /usr/local/pushpull
2. java -Djava.ext.dirs=lib org.apache.oodt.cas.pushpull.util.ExpressionValidator

> I looked up the regex for Java and the \w
> is supposed to be a word character matching alphanumeric and underscore.
> 
> I ran my regex against this online tool I found and it seems to be a valid
> match.
> http://www.regexplanet.com/advanced/java/index.html
> Regex:  TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
> 
> Input:  TES-Aura_L2-CO2-Nadir_r0000002931_F06_08.he5
> 
> 
> Thanks for the feedback and help on this.  I have tried so many different
> tweaks with backslashes, etc.  I am going to just walk away now and look at
> it later.

I think it's a protocol issue. Let me see if I can throw up those LGPL plugins 
somewhere b/c we can't host them at Apache. Or better yet, if folks have a
better ALv2 compatible FTP library, I'll happily write a PushPull plugin and 
integrate it. 

Cheers,
Chris


> 
> 
> -Cam
> 
> 
> On Tue, Dec 27, 2011 at 2:58 PM, Brian Foster <holenoter@me.com> wrote:
> 
>> Hey cameron... I think the problem is with ur
>> DirStructXmlParserFiles/TESL2CO2.xml file... for the file name regExp u are
>> specifying whitespace (i.e. \w instead of underscore)... pushpull looks
>> like it is behaving normally... it is acting like it is not finding any
>> files that match ur regExps... I wrote an app which may help u with your
>> regular expressions... in the pushpull util package in eclipse right click
>> on ExpressionValidator.java and Run As: Java Application... you can test
>> your regExp in the GUI that pops up.
>> 
>> -brian
>> 
>> Cameron Goodale <goodale@apache.org> wrote:
>> 
>>> Hey Devs,
>>> 
>>> I have been working on building an OODT PushPull User Guide from an
>> Example
>>> I am trying to get working for a project, and I have encountered a little
>>> issue (at least I hope it is little).
>>> 
>>> Here is the guide (work in progress):
>>> 
>> https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide
>>> 
>>> The setups listed in the User Guide are the same ones I am working
>> against.
>>> Now here is the log messages I am seeing.
>>> 
>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.daemon.DaemonManager
>>> setAsRunning
>>> INFO: Daemon with ID = 91131 was given permission to run
>>> org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> INFO: Testing protocol
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient . . . this
>>> may take a few minutes . . .
>>> Dec 27, 2011 10:59:00 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> SEVERE: Protocol
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClient failed
>>> compatibility test : [CogJGlobusFtpClient] Failed to get list of files :
>>> Server refused performing the request. Custom message:  (error code 1)
>>> [Nested exception message:  Custom message: Unexpected reply: 500 'ORT
>>> 97,93,139,127,210,161': command not understood.]
>>> Dec 27, 2011 10:59:00 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler
>>> getAppropriateProtocolBySite
>>> WARNING: ProtocolFactory
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory is
>> not
>>> compatible with server at ftp://l4ftl01.larc.nasa.gov
>>> Dec 27, 2011 10:59:01 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler isOkProtocol
>>> INFO: Testing protocol
>>> org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient . . . this
>>> may take a few minutes . . .
>>> Dec 27, 2011 10:59:01 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToROOT
>>> INFO: Changing to ROOT directory '/'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol
>>> cdToHOME
>>> INFO: Changing to HOME directory 'ftp://l4ftl01.larc.nasa.gov/isDir=true'
>>> Dec 27, 2011 10:59:02 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler connect
>>> INFO: Successfully connected to ftp://l4ftl01.larc.nasa.gov with protocol
>>> 'org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClient' and
>>> username 'anonymous'
>>> Dec 27, 2011 10:59:02 AM org.apache.oodt.cas.pushpull.protocol.Protocol cd
>>> INFO: Changing to directory
>>> 'ftp://l4ftl01.larc.nasa.gov/TES/TL2CO2N.005isDir=true'
>>> PageSize: 8 PageLoc: 0
>>> FileList size: 491
>>> Dec 27, 2011 10:59:03 AM
>>> org.apache.oodt.cas.pushpull.protocol.ProtocolHandler disconnect
>>> INFO: Disconnecting protocol from ftp://l4ftl01.larc.nasa.gov
>>> Dec 27, 2011 10:59:03 AM org.apache.oodt.cas.pushpull.daemon.Daemon sleep
>>> INFO: Daemon with ID = 91131 on RMI registry port 9113 is going to sleep
>>> until Tue Dec 27 11:00:00 PST 2011
>>> 
>>> 
>>> First PushPull tries to use the CogJGlobusFtpClient and it encounters an
>>> error so it switches to CommonsNetFtpClient does a couple cd commands,
>>> connects successfully then disconnects and goes back to sleep.  It will
>>> then wake up after the 3 minutes and repeat the same process.  Has anyone
>>> seen this issue or have any suggestions for a fix?
>>> 
>>> Thank you in advance.
>>> 
>>> -Cameron
>>> 
>>> P.S.  If you have any feedback on the PushPull User Guide be sure to leave
>>> comments or make changes to the wiki.
>> 


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message