Mailing-List: contact uima-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: uima-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of eaepstein@gmail.com
 designates 209.85.146.179 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:references;
        b=HE8NX6pWcfCS4eayBGGIcIAKRy+FeKkiAWjw0SBSoYm2I0dZShUxcEZwps1N1NZ2f+
         nsaY/tCKaBcn6pd/idvqNjwOlBNZ+TS2Hx2XEU4GakWBqk7WUIxMF616WGODBruxQ5eG
         r/t9SBYeaBddg/b9Na1cwvbnkVkqsB05y9rFY=
Message-ID: <cd6edfd30806161433m27d9e1dege9253edb9386b4be@mail.gmail.com>
Date: Mon, 16 Jun 2008 17:33:49 -0400
From: "Eddie Epstein" <eaepstein@gmail.com>
To: uima-user@incubator.apache.org
Subject: Re: Content segmentation
In-Reply-To: <15378a7f0806161253x3b990bc4nae4dbdd2fed78b05@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_49111_11045761.1213652029170"
References: <15378a7f0806161253x3b990bc4nae4dbdd2fed78b05@mail.gmail.com>

------=_Part_49111_11045761.1213652029170
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi Yaakov,

I wanted to find out if UIMA has any concept of content segmentation.
> Some of the analysis processing is very memory and CPU intensive and
> if the content happens to be huge (like a book), it will bring the
> server to a crawl.
>
> So, I was wondering if the UIMA framework has any notion of breaking
> up the content into smaller segments.
>

Content segmentation is a core concept in UIMA, with each CAS typically
considered to contain an "artifact" to be analyzed. Something has to segment
the input corpus into discrete artifacts.

In the most common scenario, a "collection reader" at the front of the UIMA
pipeline segments the input and initializes each CAS. For other scenarios
the "CAS Multiplier", a more general segmentation component, is used to
initialize CASes. A CAS Multiplier (CM) can be called at any point in a UIMA
pipeline; indeed multiple CM components can be used in the same pipeline.

Consider a scenario where a CM is given an input CAS with a pointer to a
large audio file. The CM could read the audio file, segment at boundaries
appropriate for subsequent analysis, and create new CASes with just the
audio content for each segment.

Note that the artifact to be analyzed, called the Subject of analysis
(Sofa), does not have to reside in the CAS itself. UIMA supports the notion
of "remote Sofas" represented in the CAS by a URI. UIMA also provides stream
access methods for remote Sofa content which in Java simply map to URI
stream reading.

Hoping this actually addresses your question,
Eddie

------=_Part_49111_11045761.1213652029170--