Mailing-List: contact user-help@uima.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@uima.apache.org
Received-SPF: pass (athena.apache.org: domain of kottmann@gmail.com designates
 209.85.215.47 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject:references
         :in-reply-to:content-type:content-transfer-encoding;
        b=Vtv7m6ajvp27kh5c0D61BqnA7IGHIM+5omt/zLO+0Gd4u1WigB/kTR63FofGqOlId4
         hjcOZm1boTmuhTVAUd2oLXDwvurCp00Kp1Wn3yk6UZ52QPIpwSsIOExqu6jWPggnDMrN
         TSWnckHbM2ER5c1i+uxt/KMrLIYTHtZEFevQY=
Message-ID: <4D6E1FEE.9020808@gmail.com>
Date: Wed, 02 Mar 2011 11:46:06 +0100
From: =?UTF-8?B?SsO2cm4gS290dG1hbm4=?= <kottmann@gmail.com>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US;
 rv:1.9.2.14) Gecko/20110221 Thunderbird/3.1.8
MIME-Version: 1.0
To: user@uima.apache.org
Subject: Re: How to process structured input with UIMA?
References: <20110302101445.274300@gmx.net>
In-Reply-To: <20110302101445.274300@gmx.net>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

On 3/2/11 11:14 AM, Andreas Kahl wrote:
> Mainly I am concerned with the latter:
> Those metadata-records would come in as XML with dozens of fields containing relatively short texts (most less than 255chars). We need to perform NLP (tokenization, stemming ...) and some simpler manipulations like reading 3 fields and constructing a 4th from that.
> It would be very desirable to use one Framework for both tasks (in fact we would use the pipeline to enrich the Metadata-Records with the long texts).
>

You could take the xml, parse it and then construct a short text which 
contains the content togehter
with annoations to mark the existing structure. This new text with the 
annotations will be placed in a new view.
Afterward you can perform your processing within these annotation bounds.

Not sure how you construct the 4th field, but when you can do that 
directly after
the xml parsing it could be part of the constructed text.

With UIMA-AS you should be able to nicely scale the analysis to a few 
machines.

Hope that helps,
Jörn