Return-Path: Delivered-To: apmail-incubator-connectors-user-archive@minotaur.apache.org Received: (qmail 83656 invoked from network); 5 Apr 2011 14:52:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Apr 2011 14:52:12 -0000 Received: (qmail 88587 invoked by uid 500); 5 Apr 2011 14:52:12 -0000 Delivered-To: apmail-incubator-connectors-user-archive@incubator.apache.org Received: (qmail 88553 invoked by uid 500); 5 Apr 2011 14:52:12 -0000 Mailing-List: contact connectors-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: connectors-user@incubator.apache.org Delivered-To: mailing list connectors-user@incubator.apache.org Received: (qmail 88545 invoked by uid 99); 5 Apr 2011 14:52:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Apr 2011 14:52:12 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [206.190.36.82] (HELO smtp104.rog.mail.re2.yahoo.com) (206.190.36.82) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 05 Apr 2011 14:52:06 +0000 Received: (qmail 66489 invoked from network); 5 Apr 2011 14:51:45 -0000 Received: from FuadPC (fuad@173.32.46.46 with login) by smtp104.rog.mail.re2.yahoo.com with SMTP; 05 Apr 2011 07:51:44 -0700 PDT X-Yahoo-SMTP: gZmgaNeswBBsQTtBq4da6l0u.vFfzVBST_YhMO5qoQUb7CY- X-YMail-OSG: OwlJdZ8VM1kxUp_81gOO20__VzzFfk9cGVqCXUjoRfVHLSQ VwK4bLxNIeVgSOhPTReD5wrZYu3cGthrJ0VlhQK27lGWwMSOTB558FlYssRD T.2sQ01qukiz4xRu7.zt6iWGVPHDklMWB8WdZclFgntRseeaJ12bf_Kkx0hh U7.8MoWVIDc1U.xmpQSMLrY29hPNcnKeYZlVP7LhFw1gKNR34ohyywEeQdZw a_AUtiPmGq_Bbz3kTV_MKzPHwFuuzVDDYUSltfWZrCvS.6s0JtZd5GFCqYJg PbGyHVK.aCwsUG9SYlrb6 X-Yahoo-Newman-Property: ymail-3 From: "Fuad Efendi" To: References: <018501cbf311$bea85e90$3bf91bb0$@efendi.ca> In-Reply-To: Subject: RE: How to add tast to queue dynamically (WebCrawler) Date: Tue, 5 Apr 2011 10:51:41 -0400 Message-ID: <008a01cbf3a0$f9c90990$ed5b1cb0$@efendi.ca> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 14.0 Thread-Index: AQKP3RrzBT12RtT36Fjx+DutxdYK9QMkxK3ukq5hGPA= Content-language: en-ca Hi Karl, So this is "retry"... can we schedule document retrieval? I retrieve = XML, generate new URL, and I want to schedule this new Document to be = retrieved at specific time -Fuad -----Original Message----- From: Karl Wright [mailto:daddywri@gmail.com]=20 Sent: April-04-11 6:36 PM To: connectors-user@incubator.apache.org Subject: Re: How to add tast to queue dynamically (WebCrawler) Actually, the method you highlight simply sets the retry timing bounds = for the document. The one that adds documents to the queue is addDocumentReference(). Chapter 7 of ManifoldCF in Action addresses this. Karl On Mon, Apr 4, 2011 at 5:46 PM, Fuad Efendi wrote: > Hi, I can understand how WebCrawler or RSS connector dynamically add=20 > new URLs to a task list=85 > > Is that something like > > =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 = activities.setDocumentScheduleBounds(urlValue, > defaultRescanTime, defaultRescanTime, null, null); > > > > In my specific case task simply stops=85 > > > > Thanks! > > > >