Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.co.in;
  h=DKIM-Signature:Received:X-Yahoo-SMTP:X-YMail-OSG:X-Yahoo-Newman-Property:Message-ID:From:To:References:Subject:Date:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Priority:X-MSMail-Priority:X-Mailer:X-MimeOLE;
  b=YVTc254als5mmul+D/YKvMGPf8a1/udTGE/VsFyVjJiNhqKY7I6QpjYD7DvSKkgeeli0PZ6VJETeG8zZDmbfhfhUJh3i3IfWonK6AbCxL38aeNY8rZZAiCgdjiWtjm/UDeGdonQIG4kuAL1OuN/EBHaB/4Pm0isOQ1NhzmXIGAY=
  ;
Message-ID: <BA003BD932EF44819FC1BC036586FBB7@sv.us.sonicwall.com>
From: "Ganesh" <emailgane@yahoo.co.in>
To: <java-user@lucene.apache.org>
References: <52AECCE6F5764C2D903CD6D9956B7831@sv.us.sonicwall.com>
 <AANLkTikCZsgvg4Ty86P0aAQvOarJhxfcy000iEEqwTrY@mail.gmail.com>
 <AANLkTinPoiUTnJ_0=s--oejjfbBLe4P97M8bWYrfZiuB@mail.gmail.com>
 <996005B2AD9E4482809CEF8E765197B7@sv.us.sonicwall.com>
 <90362ECB07906C40A0297F9D5211A24323C3D81F16@ITSEMBXCLUS.enterprise.gcal.ac.uk>
Subject: Re: PDF text extracted without spaces
Date: Fri, 3 Dec 2010 17:25:52 +0530
MIME-Version: 1.0
Content-Type: text/plain;
	charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I first extract the contents from documents using tika and latter index =
it with Lucene. The problem is the extracted text from PDF using tika =
has no whitespaces.=20

Regards
Ganesh


----- Original Message -----=20
From: "McGibbney, Lewis John" <Lewis.McGibbney@gcu.ac.uk>
To: <java-user@lucene.apache.org>
Sent: Friday, December 03, 2010 4:40 PM
Subject: RE: PDF text extracted without spaces


> Hi Ganesh
>=20
> I encountered this same problem last week. I was thinking if it was =
possible to include at minimum a WhitespaceAnalyzer somewhere within =
Tika which would solve the problem. I am not sure of how this would be =
done as I am not familiar with Tika codebase.
>=20
> Unfortunately I don't think that the solution to the first part of =
this problem lies within the java-user mailing list.
>=20
> When were you sending extracted contents to Lucene... at what later =
stage?
>=20
> Thank you
>=20
> Lewis
>=20
> -----Original Message-----
> From: Ganesh [mailto:emailgane@yahoo.co.in]
> Sent: 03 December 2010 10:44
> To: java-user@lucene.apache.org
> Subject: Re: PDF text extracted without spaces
>=20
> The main problem is i am not getting whitespace and newline char. This =
is happening only for PDF documents.
>=20
> Sample outoput: Someofthedifferencesare but it should be Some of the =
differences are
>=20
> Regards
> Ganesh
>=20
> ----- Original Message -----
> From: "Alexander Aristov" <alexander.aristov@gmail.com>
> To: <java-user@lucene.apache.org>
> Sent: Friday, December 03, 2010 2:39 PM
> Subject: Re: PDF text extracted without spaces
>=20
>=20
>> anyway even if you get correct whitespaces and new lines this won't =
affect
>> indexing.
>>
>> Best Regards
>> Alexander Aristov
>>
>>
>> On 3 December 2010 10:00, Lance Norskog <goksron@gmail.com> wrote:
>>
>>> The text should come out as a stream of words with space, but =
without
>>> any of the formatting in the PDF. Extraction is only good enough to
>>> tell you that a word is somewhere inside a PDF file.  Can you post a
>>> short bit of the text that it extracted?
>>>
>>> Also, you should try this test on different PDF files that were made
>>> with different software.
>>>
>>> On Thu, Dec 2, 2010 at 9:35 PM, Ganesh <emailgane@yahoo.co.in> =
wrote:
>>> > Hello all,
>>> >
>>> > I know, this is not the right group to ask this question, thought =
some of
>>> you guys might have experienced.
>>> >
>>> > I newbie with Tika. I am using latest version 0.8 version. I =
extracted
>>> text from PDF document but found spaces and new line missing. =
Indexing the
>>> data gives wrong result. Could any one in this group could help me? =
I am
>>> using tika directly to extract the contents, which later gets =
indexed.
>>> >
>>> > Regards
>>> > Ganesh
>>> > Send free SMS to your Friends on Mobile from your Yahoo! =
Messenger.
>>> Download Now! http://messenger.yahoo.com/download.php
>>> >
>>> > =
---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> > For additional commands, e-mail: java-user-help@lucene.apache.org
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Lance Norskog
>>> goksron@gmail.com
>>>
>>> =
---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>>
>>>
>>
> Send free SMS to your Friends on Mobile from your Yahoo! Messenger. =
Download Now! http://messenger.yahoo.com/download.php
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>=20
> Email has been scanned for viruses by Altman Technologies' email =
management service - www.altman.co.uk/emailsystems
>=20
> Glasgow Caledonian University is a registered Scottish charity, number =
SC021474
>=20
> Winner: Times Higher Education=E2=80=99s Widening Participation =
Initiative of the Year 2009 and Herald Society=E2=80=99s Education =
Initiative of the Year 2009
> =
http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,6219=
,en.html
>
Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now! http://messenger.yahoo.com/download.php

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org