oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: question on push pull
Date Wed, 29 Feb 2012 16:03:20 GMT
Hey Guys,

Just wanted to loop in on this. Yes, push pull does support download
of full directory trees. Probably the best guide to check out is Brian's
documentation on the DirFileStructXML here:


I also wrote a static user guide here:


One thing to note too is that some of the plugins for Push Pull that
have been develop use non ALv2 compatible code, so if you want
those plugins for now (until someone writes nice shiny new ALv2
compatible versions which I would LOVE), you can find them here
at Apache Extras:


That you can cull information from. If you have any further specific
questions I can help.



On Feb 28, 2012, at 7:40 AM, Cameron Goodale wrote:

> Luca,
> I haven't tried this exact use case within Crawler, but Crawler does
> support scp and I have used 'scp -r' to recursively download a folder and
> all content housed within.  I can only imagine ftp has a similar recursive
> option as well.
> Maybe another more Crawler Savy dev can shine some light on the recursion
> use case when using Crawler.
> -Cameron
> P.S. When we get a final answer let's add this to the Crawler User Guide
> Wiki too as an example use case.  Glad you found the Crawler Wiki page
> useful.
> On Tue, Feb 28, 2012 at 7:01 AM, Cinquini, Luca (3880) <
> Luca.Cinquini@jpl.nasa.gov> wrote:
>> Hi all,
>>       I have a quick question concerning the pushpull framework : is
>> there any way to transfer full directory trees, as opposed to single files
>> ? And which of the currently implemented transfer protocols would allow
>> that ? I haven't see any examples on that, though I might have missed it.
>> thanks a lot,
>> Luca
>> P.S.: Cameron, thanks for writing the push-pull user guide - it's great.
> -- 
> Sent from a Tin Can attached to a String

Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA

View raw message