oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <lewis.mcgibb...@gmail.com>
Subject CAS Crawler Crawling Code
Date Thu, 01 May 2014 17:35:50 GMT
Hi Folks,
Im sitting jumping between ProductCrawler and StdIngester trying to pin
point _exactly_ where product fetching actually happens.
I'm aware of the triple headed nature of crawler workflows e.g.
preIngestion, postIngestionSuccess and postIngestionFailure... I can see
the logic within the ProductCrawler code... what I cannot locate is where
HTTP/transport socket connections are created and used.
Can anyone please point this out?

View raw message