oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Bennett <tbenn...@ska.ac.za>
Subject cas-crawler does not pass preconditions
Date Wed, 01 Jun 2011 19:54:59 GMT
Hi,

I've successfully got the CmdLineIngester working with an ExternMetExtractor
(written in python):

However, when I try launch the crawler I get a warning telling me the
the preconditions for ingest have not been met. No .met file has been
created.

Two questions:
1) I'm just wondering if there is any configuration that I'm missing.
2) Where should I start hunting in the code or logs to find out why my met
extractor was not run?

Kind regards,
Thomas

For your reference, here is the command and output.

bin$ ./crawler_launcher --crawlerId StdProductCrawler --productPath
/usr/local/meerkat/data/staging/products/hdf5 --filemgrUrl
http://localhost:9000 --failureDir /tmp --actionIds DeleteDataFile
MoveDataFileToFailureDir Unique --metFileExtension met --clientTransferer
org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory
--metExtractor org.apache.oodt.cas.metadata.extractors.ExternMetExtractor
--metExtractorConfig
/usr/local/meerkat/extractors/katextractor/katextractor.config
http://localhost:9000
StdProductCrawler
Jun 1, 2011 9:48:07 PM org.apache.oodt.cas.crawl.ProductCrawler crawl
INFO: Crawling /usr/local/meerkat/data/staging/products/hdf5
Jun 1, 2011 9:48:07 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile
INFO: Handling file
/usr/local/meerkat/data/staging/products/hdf5/1263940095.h5
Jun 1, 2011 9:48:07 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile
WARNING: Failed to pass preconditions for ingest of product:
[/usr/local/meerkat/data/staging/products/hdf5/1263940095.h5]

Mime
View raw message