Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@oodt.apache.org
Received-SPF: pass (nike.apache.org: local policy)
From: "Verma, Rishi (317I)" <Rishi.Verma@jpl.nasa.gov>
To: "dev@oodt.apache.org" <dev@oodt.apache.org>
Date: Wed, 29 Dec 2010 11:42:56 -0800
Subject: Re: Filemanager how to only metadata
Thread-Topic: Filemanager how to only metadata
Thread-Index: AcunkJoBh6BrbUixSy6jR5dODvdQyQ==
Message-ID: <9AB44848-372E-4D1E-BFDA-F943392379A0@jpl.nasa.gov>
References: <1FD6546A-7355-4F40-BA25-E172D416A501@jpl.nasa.gov>
 <119FFB53-9D7E-476D-9B3C-4C0C9F2BD09D@me.com>
 <C34C0644-BBA9-48A7-9DB7-034C0D62AB80@jpl.nasa.gov>
 <1F6B9408-DB80-4AEE-9F3A-120DFE6F5F41@jpl.nasa.gov>
 <102ABD08-40E3-4E0D-8D44-631456BC33CC@jpl.nasa.gov>
 <D3D5F38C-6F61-4FA1-9307-1CA0FE6FA867@jpl.nasa.gov>
In-Reply-To: <D3D5F38C-6F61-4FA1-9307-1CA0FE6FA867@jpl.nasa.gov>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi Chris,

Thanks for your help! I didn't realize '--clientTransfer' was necessary, bu=
t I now got the metadata ingest to work.

Thanks!
Rishi

On Dec 28, 2010, at 5:26 PM, Mattmann, Chris A (388J) wrote:

> Hi Rishi,
>=20
>=20
>> The filemgr-client usage statement seems to indicate support only for (-=
-clienTransfer or --dataTransfer) options, not the "--transferFactory" as y=
ou suggested.
>=20
> Sorry, I didn't know you interpreted my recollection of the *exact parame=
ter name* literally. YMMV doing that. The best bet will always be to check =
the cmd line usage (with no args like you did) for the most up-to-date usag=
e.
>=20
>> In any case though, I tried a couple parameter arguments with filemgr-cl=
ient, but all yield an error saying a product specified with --refs could n=
ot be located:
>>=20
>> 1) ./filemgr-client ... --transferFactory InPlaceDataTransferFactory --r=
efs file:///doesnotexist
>>=20
>> 2) ./filemgr-client ... --dataTransfer InPlaceDataTransferFactory --refs=
 file:///doesnotexist
>>=20
>> 3) ./filemgr-client ... --dataTransfer org.apache.oodt.cas.filemgr.datat=
ransfer.InPlaceDataTransfererFactory --refs file:///doesnotexist
>>=20
>> 4) ./filemgr-client ... --transferFactory InPlaceDataTransfer --refs fil=
e:///doesnotexist
>=20
> None of the above will would because they all omit the use of:
>=20
> --clientTransfer
>  NOTE: this parameter tells the File Manager that the FM Client will be d=
oing the actually data transferring, rather than the FM Server.
>=20
> So, basically what you do is you provide both the switch to turn on clien=
t transfer *and* the appropriate data transfer factory. Try:
>=20
>  --clientTransfer --dataTransfer org.apache.oodt.cas.filemgr.datatransfer=
.InPlaceDataTransferFactory
>=20
> HTH!
>=20
> Cheers,
> Chris
>=20
>>=20
>> On Dec 28, 2010, at 2:12 PM, Chris A Mattmann wrote:
>>=20
>> Hi Rishi,
>>=20
>> Thanks. You just need to specify InPlaceDataTransfer as the --transferFa=
ctory parameter to the fmClient or to the crawler (which also expects a tra=
nsfer factory)...
>>=20
>> Cheers,
>> Chris
>>=20
>> On Dec 28, 2010, at 1:54 PM, Verma, Rishi (317I) wrote:
>>=20
>> Hi -
>>=20
>> Thanks for the helpful tips.
>>=20
>> I was looking at InPlaceDataTransferer, and it does not seem to have a c=
ommand line interface (there's no main). Specifically, I looked at the clas=
s
>> "org.apache.oodt.cas.filemgr.datatransfer.InPlaceDataTransferer"
>>=20
>> Is there a command-line wrapper already built I can use?
>>=20
>> Thanks again!
>> Rishi
>>=20
>>=20
>> On Dec 23, 2010, at 3:44 PM, holenoter wrote:
>>=20
>>=20
>> sounds like a case for the profile/product server . . . but if you reall=
y want to use the filemgr, you can just use the InPlaceDataTransferer . . .=
 if you mean by "i don't have the product on hand" meaning it is stored som=
ewhere else, then just put that url where it is stored as the --ref arg . .=
 . otherwise, if the product isn't anywhere, just put a random url as the a=
rg to --ref (e.g. file:///some/file/i/dont/have) . . . it will at least let=
 you get the metadata in
>>=20
>> -brian
>>=20
>> On Dec 23, 2010, at 2:28 PM, Verma, Rishi (317I) wrote:
>>=20
>> Hi everyone,
>>=20
>> I'm experimenting with OODT filemanager, and wanted to ingest a product =
file's met into the filemgr catalog.
>>=20
>> I don't have the product file on hand, but I do have the metadata.
>>=20
>> The filemgr user's guide (ie. http://oodt.apache.org/components/maven/fi=
lemgr/user/basic.html) documents how to ingest a product file assuming you =
actually have the product on hand. However, if I only want to ingest the me=
tadata, how would I go about doing this?
>>=20
>> The 'filemgr-client' script seems to not allow ignoring the product refe=
rence. In other words, I cannot simply eliminate the "--refs" flag.
>>=20
>>=20
>> ./filemgr-client --url http://localhost:9000 --operation \
>> --ingestProduct --productName blah.txt --productStructure Flat \
>> --productTypeName GenericFile \
>> --metadataFile file:///usr/local/cas-filemgr-v1.8.0/bin/blah.txt.met \
>> --refs file:///usr/local/cas-filemgr-v1.8.0/bin/blah.txt
>>=20
>>=20
>> Any tips on how to ingest metadata only?
>>=20
>> Thanks!
>> Rishi
>>=20
>>=20
>>=20
>>=20
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov<mailto:chris.a.mattmann@nasa.gov>
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>=20
>>=20
>=20
>=20
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>=20