Mailing-List: contact dev-help@jackrabbit.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@jackrabbit.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Subject: AW: Workspace.copy() Question ...
Date: Tue, 18 Nov 2008 13:09:30 +0100
Message-ID: <F186AC080E44C146BBE4A33472CFA79F022BA922@mxs01.tirol.local>
In-Reply-To: <510143ac0811171001k18d5e056red4425d7d48b309d@mail.gmail.com>
Thread-Topic: Workspace.copy() Question ...
Thread-Index: AclI3pC1mNZ9okpYQm2QiCR5aWOCyAAlEGSg
References: <F186AC080E44C146BBE4A33472CFA79F0222579F@mxs01.tirol.local>
 <91f3b2650811110106x3c2b576al25ed830de10aa470@mail.gmail.com>
 <510143ac0811120310s4f6bdbe8g5f6ec8361c00c6c4@mail.gmail.com>
 <91f3b2650811120636t63fe0d1al7f4952005e064774@mail.gmail.com>
 <F186AC080E44C146BBE4A33472CFA79F022BA307@mxs01.tirol.local>
 <91f3b2650811170102h2933402boca2960b8543f07de@mail.gmail.com>
 <510143ac0811170143t740091d1wbe8c9a47bc103bca@mail.gmail.com>
 <91f3b2650811170207s15084536q8c96230496df9810@mail.gmail.com>
 <510143ac0811171001k18d5e056red4425d7d48b309d@mail.gmail.com>
From: =?iso-8859-1?Q?K=D6LL_Claus?= <C.KOELL@TIROL.GV.AT>
To: <dev@jackrabbit.apache.org>

hi guys,

for my understanding ...

>Probably not in the Lucene index files itself. Text extraction could be =
used without using the Lucene index, for example to display the text =
content of a >PDF file. The text extraction module could store the =
DataIdentifier together with the extracted text ('payload'). The =
advantage to store this 'payload' >near the actual binary is that the =
data is deleted when the binary is garbage collected. So maybe it =
actually is better to store the 'payload' (extracted >text, virus =
scanner flag, thumbnail) near the binary, so it is automatically garbage =
collected when the binary is garbage collected. We would need to >define =
an API and the behavior for this 'payload storage'. It probably doesn't =
need to be transactional, but it needs to be consistent (a checksum). =
>Some kind of binary properties file maybe, with put(String key, =
InputStream payload), and InputStream get(String key).

... thomas you are talking about a textextraction module but i can not =
follow you,
As far as i understand, you will change the architectur going to modules
such like textactraction, viruscanner or thumbnailbuilder so they can =
store the informations with
the dataidentifier and the result in the datastore ?
if the gc will delete a entry in the datastore based on the =
dataIdentifier the
"near" informations will also be deleted automatilally ?

as you wrote the main problem is that we do not know if we have already =
processed a binary
it would be fine if we internally create a dataIdentifier of a binary =
stream and give them
to such modules like textextractor or what else so they can look for a =
result that
was already be processed and stored.

is that also what you think ;-)