Mailing-List: contact user-help@oodt.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@oodt.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: "Mattmann, Chris A (388J)" <chris.a.mattmann@jpl.nasa.gov>
To: "user@oodt.apache.org" <user@oodt.apache.org>
Date: Fri, 18 Nov 2011 16:55:32 -0800
Subject: Re: crawler with unique action fails on first ingest
Thread-Topic: crawler with unique action fails on first ingest
Thread-Index: AcymVeC/qliPQPzLS8WiG8lHtIzbUg==
Message-ID: <1A9BA495-E43D-41CD-9F55-36E1A61FBA16@jpl.nasa.gov>
References: <3CC10DCC-E540-4E76-A38E-AB2259E0FD5E@chla.usc.edu>
In-Reply-To: <3CC10DCC-E540-4E76-A38E-AB2259E0FD5E@chla.usc.edu>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hey Ricky,

I've ran into this a number of times myself and recently Paul Ramirez and I=
 were talking about this too. Paul even=20
said he would try and fix it (ha! I'm signing him up for work :P ). Actuall=
y I'll just look at it myself.

In the meanwhile, the workaround is exactly the one you stated. Ingest a fi=
le, that gets you a catalog. Then, you can=20
simply delete the file if you want using fmquery | fmdel and then Unique wo=
rks just fine.

Cheers,
Chris

On Nov 18, 2011, at 4:52 PM, Nguyen, Ricky wrote:

> Hi,
>=20
> I am trying to run a crawler using "--actionIds Unique". Since this is th=
e first time I am ingesting a file into FileMgr, the user guide [1] says th=
at the catalog dir MUST NOT exist so that Lucene can create it. However, th=
e crawler fails with the error:
>=20
> IOException when opening index directory: [/Users/rnguyen/vpicu/data/cata=
log] for search: Message: /Users/rnguyen/vpicu/data/catalog is not a direct=
ory
>=20
> Seems like crawler is trying to search for a product (to determine it's u=
niqueness), but the catalog hasn't been created yet. I guess since I have n=
o catalog, the workaround is to omit the "Unique" action.
>=20
> But if I use crawler as a daemon, it would be useful to leave "Unique" as=
 an action. Any thoughts on the right course?
>=20
> Thanks,
> Ricky
>=20
> [1] http://oodt.apache.org/components/maven/filemgr/user/basic.html
>=20
>=20
> ---------------------------------------------------------------------
> CONFIDENTIALITY NOTICE: This e-mail message, including any attachments,=20
> is for the sole use of the intended recipient(s) and may contain confiden=
tial
> or legally privileged information. Any unauthorized review, use, disclosu=
re
> or distribution is prohibited. If you are not the intended recipient, ple=
ase
> contact the sender by reply e-mail and destroy all copies of this origina=
l message. =20
>=20
> ---------------------------------------------------------------------
>=20


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++