Mailing-List: contact user-help@nutch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@nutch.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Content-Type: multipart/alternative;
 boundary="========GMXBoundary42981328544232899363"
Date: Mon, 06 Feb 2012 11:03:52 -0500
From: "Danicela nutch" <Danicela-nutch@mail.com>
Message-ID: <20120206160352.42980@gmx.com>
MIME-Version: 1.0
Subject: Re : Re: Too few parsed pages
To: user@nutch.apache.org,markus.jelsma@openindex.io

--========GMXBoundary42981328544232899363
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 8bit

I don't understand, what should I do ?

----- Message d'origine -----
De : Markus Jelsma
Envoyés : 06.02.12 16:45
À : user@nutch.apache.org
Objet : Re: Too few parsed pages

 Likely db_not_modified records, they are not parsed. On Monday 06 February 2012 16:44:25 Danicela nutch wrote: > Hi, > > When I make a readseg -list on a segment, I have 60.000 'FETCHED' pages, > but only 10.000 'PARSED' pages. One month ago, I had something like 40.000 > 'PARSED' pages in my segments, and this number reduced a little every day. > If I look in the logs of the segments, I can find approximately these > numbers if I count the number of treated pages. But I find nothing strange > in the parse that could explain the fact I have so few pages in the end. > > What can explain the fact I have so few pages which are parsed ? > > Thanks. -- Markus Jelsma - CTO - Openindex

--========GMXBoundary42981328544232899363--