oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sheryl John <shery...@gmail.com>
Subject Re: Problem happened when I tried to run the script "crawler_launcher"
Date Mon, 06 Aug 2012 17:01:05 GMT
Hi Yunhee,

Check out this OODT wiki for crawler :
https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help

Did you try giving 'http://localhost:8000' without the "/" in the end?
Also, specify 'org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory'
for  'clientTransferer' option.


On Mon, Aug 6, 2012 at 9:46 AM, YunHee Kang <yunh.kang@gmail.com> wrote:

> Hi Chris,
>
> I got an error message when I tried to run crawler_launcher by using a
> shell script. The error message may be caused by a  wrong URL of
> filemgr.
>  $ ./crawler_launcher.sh
> ERROR: Validation Failures: - Value 'http://localhost:8000/' is not
> allowed for option
> [longOption='filemgrUrl',shortOption='fm',description='File Manager
> URL'] - Allowed values = [http://.*:\d*]
>
> The following is the shell script that I wrote:
> $ cat crawler_launcher.sh
> #!/bin/sh
> export STAGE_AREA=/home/yhkang/oodt-0.5/cas-pushpull/staging/TESL2CO2
> ./crawler_launcher \
>        -op --launchStdCrawler \
>        --productPath $STAGE_AREA\
>        --filemgrUrl http://localhost:8000/\
>        --failureDir /tmp \
>        --actionIds DeleteDataFile MoveDataFileToFailureDir Unique \
>        --metFileExtension tmp \
>        --clientTransferer
> org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferer
>
> I am wondering if there is a problem in the URL of the filemgr or elsewhere
>
> Thanks,
> Yunhee
>



-- 
-Sheryl

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message