Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 40E1B18AF6 for ; Sun, 3 Apr 2016 05:35:22 +0000 (UTC) Received: (qmail 98604 invoked by uid 500); 3 Apr 2016 05:35:22 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 98561 invoked by uid 500); 3 Apr 2016 05:35:22 -0000 Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@oodt.apache.org Delivered-To: mailing list dev@oodt.apache.org Received: (qmail 98550 invoked by uid 99); 3 Apr 2016 05:35:21 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2016 05:35:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 44EC4C2286 for ; Sun, 3 Apr 2016 05:35:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.281 X-Spam-Level: X-Spam-Status: No, score=0.281 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 9O1lO7qu84jq for ; Sun, 3 Apr 2016 05:35:18 +0000 (UTC) Received: from mx0b-00183501.pphosted.com (mx0b-00183501.pphosted.com [67.231.157.38]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 277F65F257 for ; Sun, 3 Apr 2016 05:35:18 +0000 (UTC) Received: from pps.filterd (m0084794.ppops.net [127.0.0.1]) by m0084794.ppops.net (8.16.0.11/8.16.0.11) with SMTP id u335Y5T4006466 for ; Sun, 3 Apr 2016 01:35:10 -0400 Received: from ussumndadlp05.celgene.com ([216.118.82.116]) by m0084794.ppops.net with ESMTP id 222u6f84n6-1 (version=TLSv1 cipher=AES256-SHA bits=256 verify=NO) for ; Sun, 03 Apr 2016 01:35:09 -0400 Received: from ustls.celgene.com ([10.22.65.64]) by USSUMNDADLP05.celgene.com (8.13.8/8.13.8) with ESMTP id u335Z8oF016611 for ; Sun, 3 Apr 2016 01:35:09 -0400 Received: from USSUMSPEXCMBX01.celgene.com ([169.254.2.3]) by USSUMSPEXCCAS02.celgene.com ([10.22.64.42]) with mapi id 14.03.0266.001; Sun, 3 Apr 2016 01:34:48 -0400 From: Konstantinos Mavrommatis To: "dev@oodt.apache.org" Subject: Transition from OODT 0.6 to 0.12 cannot find extractor specifications Thread-Topic: Transition from OODT 0.6 to 0.12 cannot find extractor specifications Thread-Index: AdGNaojOTdpbd+BYRBit4+9Q2W8lIg== Date: Sun, 3 Apr 2016 05:34:48 +0000 Message-ID: <0ED7EB96706C8E44B4B5B13C07026282B80900A1@USSUMSPEXCMBX01.celgene.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.22.65.64] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-RCIS-Action: ALLOW X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-04-03_03:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=0 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1601100000 definitions=main-1604030085 Hi, I am trying to replicate a fully functional service that I had setup long t= ime ago using OODT 0.6 but I am having the following problem that does not = allow me to ingest files. When I try to ingest files with the extension fas= tq.gz I get the line: WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/E837642_R1.fastq.gz Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile And of course the file is not ingested. This process works without problem = with OODT 0.6 on a different server. The crawler command I am running is: ./crawler_launcher \ --operation \ --launchAutoCrawler \ --productPath $FILEPATH \ --filemgrUrl $OODT_FILEMGR_URL \ --clientTransferer org.apache.oodt.cas.filemgr.datatransfer.InPlaceDataTran= sferFactory \ --mimeExtractorRepo ../policy/mime-extractor-map.xml \ --noRecur \ --crawlForDirs 2>&1 I have setup OODT 0.12 on a server which runs FM listening to port 9000. >From a client machine I have verified that I can use FM to ingest products. I am now trying to use crawler to crawl and ingest all files in a directory= . Since I have non standard MIME types in these directories I have done the= following: 1. Added my own mime types in policy/mimetypes.xml eg 2. created the file policy/mime-extractor-map.xml 3. created the file fastq.config /apache-oodt/crawler/bin/MetExtractorNGS.pl fastq The MetExtractorNGS.pl is a small perl script that opens the file to be ing= ested, gets some information and stores it in the .met file that correspond= s to the file to be ingested and have manually verified that works as expec= ted producing the correct met file. What am I missing here? Any ideas comments suggestions will be greatly appr= eciated. Thanks in advance for any help Kostas PS1 The full output from running the crawler command follows: Setting property 'StdProductCrawler.filemgrUrl' Setting property 'MetExtractorProductCrawler.filemgrUrl' Setting property 'AutoDetectProductCrawler.filemgrUrl' Setting property 'StdProductCrawler.clientTransferer' Setting property 'MetExtractorProductCrawler.clientTransferer' Setting property 'AutoDetectProductCrawler.clientTransferer' Setting property 'StdProductCrawler.noRecur' Setting property 'MetExtractorProductCrawler.noRecur' Setting property 'AutoDetectProductCrawler.noRecur' Setting property 'AutoDetectProductCrawler.mimeExtractorRepo' Setting property 'StdProductCrawler.productPath' Setting property 'MetExtractorProductCrawler.productPath' Setting property 'AutoDetectProductCrawler.productPath' Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'AutoDetectProductCrawler.noRecur' set to value [true] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'StdProductCrawler.productPath' set to value [/mnt/celgene.r= nd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'MetExtractorProductCrawler.noRecur' set to value [true] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'AutoDetectProductCrawler.mimeExtractorRepo' set to value [.= ./policy/mime-extractor-map.xml] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'MetExtractorProductCrawler.clientTransferer' set to value [= org.apache.oodt.cas.filemgr.datatransfer.InPlaceDataTransferFactory] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'AutoDetectProductCrawler.filemgrUrl' set to value [http://1= 92.168.8.44:9000] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'AutoDetectProductCrawler.clientTransferer' set to value [or= g.apache.oodt.cas.filemgr.datatransfer.InPlaceDataTransferFactory] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'StdProductCrawler.noRecur' set to value [true] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'StdProductCrawler.filemgrUrl' set to value [http://192.168.= 8.44:9000] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'AutoDetectProductCrawler.productPath' set to value [/mnt/ce= lgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'MetExtractorProductCrawler.filemgrUrl' set to value [http:/= /192.168.8.44:9000] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'StdProductCrawler.clientTransferer' set to value [org.apach= e.oodt.cas.filemgr.datatransfer.InPlaceDataTransferFactory] Apr 02, 2016 10:12:13 PM org.springframework.beans.factory.config.PropertyO= verrideConfigurer processKey FINE: Property 'MetExtractorProductCrawler.productPath' set to value [/mnt/= celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq] Apr 02, 2016 10:12:13 PM org.apache.oodt.cas.crawl.ProductCrawler crawl INFO: Crawling /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/Ra= wData/fastq Apr 02, 2016 10:12:13 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/E837642_R1.fastq.gz Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.crawl.AutoDetectProductCrawler= passesPreconditions WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/E837642_R1.fastq.gz Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile WARNING: Failed to pass preconditions for ingest of product: [/mnt/celgene.= rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/E837642_R1.fastq= .gz] Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/E837642_R1.fastq.gz.met Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.metadata.preconditions.PreCond= EvalUtils eval INFO: Passed precondition comparator id CheckThatDataFileSizeIsGreaterThanZ= ero Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Generating met file for product file: [/mnt/celgene.rnd.combio.mmgp.e= xternal/TestSeqData/RNA-Seq/RawData/fastq/E837642_R1.fastq.gz.met] Apr 02, 2016 10:12:14 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Executing command line: [/celgene/software/apache-oodt/crawler/bin/Me= tExtractorNGS.pl /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/= RawData/fastq/E837642_R1.fastq.gz.met text ] with workingDir: [/mnt/celgene= .rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq] to extract met= adata OUTPUT: [WARN : MetExtractorNGS - 2016/04/02 22:12:15] - Input file /mnt/ce= lgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/E837642_R1= .fastq.gz.met will be ignored. .met files are not processed ! Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile SEVERE: Failed to get metadata for product : Met extractor failed to create= metadata file org.apache.oodt.cas.metadata.exceptions.MetExtractionException: Met extract= or failed to create metadata file at org.apache.oodt.cas.metadata.extractors.ExternMetExtractor.extrM= etadata(ExternMetExtractor.java:120) at org.apache.oodt.cas.metadata.AbstractMetExtractor.extractMetadat= a(AbstractMetExtractor.java:74) at org.apache.oodt.cas.crawl.AutoDetectProductCrawler.getMetadataFo= rProduct(AutoDetectProductCrawler.java:84) at org.apache.oodt.cas.crawl.ProductCrawler.handleFile(ProductCrawl= er.java:136) at org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.ja= va:104) at org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.ja= va:74) at org.apache.oodt.cas.crawl.cli.action.CrawlerLauncherCliAction.ex= ecute(CrawlerLauncherCliAction.java:58) at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.ja= va:331) at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:1= 88) at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.j= ava:36) Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/E837642_R2.fastq.gz Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.crawl.AutoDetectProductCrawler= passesPreconditions WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/E837642_R2.fastq.gz Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile WARNING: Failed to pass preconditions for ingest of product: [/mnt/celgene.= rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/E837642_R2.fastq= .gz] Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/E837642_R2.fastq.gz.met Apr 02, 2016 10:12:15 PM org.apache.oodt.cas.metadata.preconditions.PreCond= EvalUtils eval INFO: Passed precondition comparator id CheckThatDataFileSizeIsGreaterThanZ= ero Apr 02, 2016 10:12:16 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Generating met file for product file: [/mnt/celgene.rnd.combio.mmgp.e= xternal/TestSeqData/RNA-Seq/RawData/fastq/E837642_R2.fastq.gz.met] Apr 02, 2016 10:12:16 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Executing command line: [/celgene/software/apache-oodt/crawler/bin/Me= tExtractorNGS.pl /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/= RawData/fastq/E837642_R2.fastq.gz.met text ] with workingDir: [/mnt/celgene= .rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq] to extract met= adata OUTPUT: [WARN : MetExtractorNGS - 2016/04/02 22:12:16] - Input file /mnt/ce= lgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/E837642_R2= .fastq.gz.met will be ignored. .met files are not processed ! Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile SEVERE: Failed to get metadata for product : Met extractor failed to create= metadata file org.apache.oodt.cas.metadata.exceptions.MetExtractionException: Met extract= or failed to create metadata file at org.apache.oodt.cas.metadata.extractors.ExternMetExtractor.extrM= etadata(ExternMetExtractor.java:120) at org.apache.oodt.cas.metadata.AbstractMetExtractor.extractMetadat= a(AbstractMetExtractor.java:74) at org.apache.oodt.cas.crawl.AutoDetectProductCrawler.getMetadataFo= rProduct(AutoDetectProductCrawler.java:84) at org.apache.oodt.cas.crawl.ProductCrawler.handleFile(ProductCrawl= er.java:136) at org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.ja= va:104) at org.apache.oodt.cas.crawl.ProductCrawler.crawl(ProductCrawler.ja= va:74) at org.apache.oodt.cas.crawl.cli.action.CrawlerLauncherCliAction.ex= ecute(CrawlerLauncherCliAction.java:58) at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.ja= va:331) at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:1= 88) at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.j= ava:36) Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/cas-crawler-04-02-16.log.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.AutoDetectProductCrawler= passesPreconditions WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-04-02-16.log.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile WARNING: Failed to pass preconditions for ingest of product: [/mnt/celgene.= rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-04-0= 2-16.log.gz] Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/cas-crawler-04-02-16.tar.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.AutoDetectProductCrawler= passesPreconditions WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-04-02-16.tar.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile WARNING: Failed to pass preconditions for ingest of product: [/mnt/celgene.= rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-04-0= 2-16.tar.gz] Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/cas-crawler-mnt-celgene.rnd.combio.mmgp.external-TestSeqDa= ta-RNA-Seq-RawData-fastq-04-02-16.tar.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.AutoDetectProductCrawler= passesPreconditions WARNING: No extractor specs specified for /mnt/celgene.rnd.combio.mmgp.exte= rnal/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-mnt-celgene.rnd.combio.m= mgp.external-TestSeqData-RNA-Seq-RawData-fastq-04-02-16.tar.gz Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile WARNING: Failed to pass preconditions for ingest of product: [/mnt/celgene.= rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/cas-crawler-mnt-= celgene.rnd.combio.mmgp.external-TestSeqData-RNA-Seq-RawData-fastq-04-02-16= .tar.gz] Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Handling file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-S= eq/RawData/fastq/test Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.metadata.preconditions.PreCond= EvalUtils eval INFO: Passed precondition comparator id CheckThatDataFileSizeIsGreaterThanZ= ero Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Generating met file for product file: [/mnt/celgene.rnd.combio.mmgp.e= xternal/TestSeqData/RNA-Seq/RawData/fastq/test] Apr 02, 2016 10:12:17 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Executing command line: [/celgene/software/apache-oodt/crawler/bin/Me= tExtractorNGS.pl /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/= RawData/fastq/test text ] with workingDir: [/mnt/celgene.rnd.combio.mmgp.ex= ternal/TestSeqData/RNA-Seq/RawData/fastq] to extract metadata OUTPUT: [DEBUG : MetExtractorNGS - 2016/04/02 22:12:18] - Accessing NGS ser= ver at http://192.168.8.44:8082/RPC2 OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: meta= data for file_host are not in array format.Converting.. OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: addi= ng key/value [file_host]/[ip-192-168-8-66] OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: meta= data for ProductType are not in array format.Converting.. OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: addi= ng key/value [ProductType]/[GenericFile] OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: meta= data for ingest_user are not in array format.Converting.. OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: addi= ng key/value [ingest_user]/[kmavrommatis] OUTPUT: [DEBUG : MetExtractorNGS - 2016/04/02 22:12:18] - The file path is = ARRAY(0x22d3f48). It will be added under the FilePath metadata field OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: meta= data for FilePath are not in array format.Converting.. OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - addMetadata: addi= ng key/value [FilePath]/[/mnt/celgene.rnd.combio.mmgp.external/TestSeqData/= RNA-Seq/RawData/fastq/test] OUTPUT: [DEBUG : MetExtractorNGS - 2016/04/02 22:12:18] - This file is of t= ype text OUTPUT: [DEBUG : MetExtractorNGS - 2016/04/02 22:12:18] - Storing metadata = in file /mnt/celgene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/f= astq/test.met OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - Changing /mnt/cel= gene.rnd.combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/test to OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - /mnt/celgene.rnd.= combio.mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/test OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - Changing kmavromm= atis to OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - kmavrommatis OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - Changing GenericF= ile to OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - GenericFile OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - Changing ip-192-1= 68-8-66 to OUTPUT: [DEBUG : metadataPrepare - 2016/04/02 22:12:18] - ip-192-168-8-66 OUTPUT: [DEBUG : MetExtractorNGS - 2016/04/02 22:12:19] - Process finished = SUCCESSFULLY Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.metadata.extractors.ExternMetE= xtractor extrMetadata INFO: Met extraction successful for product file: [/mnt/celgene.rnd.combio.= mmgp.external/TestSeqData/RNA-Seq/RawData/fastq/test] Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.crawl.ProductCrawler ingest INFO: ProductCrawler: Ready to ingest product: [/mnt/celgene.rnd.combio.mmg= p.external/TestSeqData/RNA-Seq/RawData/fastq/test]: ProductType: [GenericFi= le] Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.filemgr.ingest.StdIngester set= FileManager INFO: StdIngester: connected to file manager: [http://192.168.8.44:9000] Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.filemgr.datatransfer.InPlaceDa= taTransferer setFileManagerUrl INFO: In Place Data Transfer to: [http://192.168.8.44:9000] enabled Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.filemgr.ingest.StdIngester ing= est INFO: StdIngester: ingesting product: ProductName: [test]: ProductType: [Ge= nericFile]: FileLocation: [/mnt/celgene.rnd.combio.mmgp.external/TestSeqDat= a/RNA-Seq/RawData/fastq/] Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManag= erClient ingestProduct FINEST: File Manager Client: clientTransfer enabled: transfering product [t= est] Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.filemgr.versioning.VersioningU= tils createBasicDataStoreRefsFlat FINE: VersioningUtils: Generated data store ref: file:/opt/oodt/data/archiv= e/test/test from origRef: file:/mnt/celgene.rnd.combio.mmgp.external/TestSe= qData/RNA-Seq/RawData/fastq/test Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.crawl.ProductCrawler ingest INFO: Successfully ingested product: [/mnt/celgene.rnd.combio.mmgp.external= /TestSeqData/RNA-Seq/RawData/fastq/test]: product id: 4c8de2da-265a-48c4-83= 80-3f1103dfecfc Apr 02, 2016 10:12:19 PM org.apache.oodt.cas.crawl.ProductCrawler handleFile INFO: Successful ingest of product: [/mnt/celgene.rnd.combio.mmgp.external/= TestSeqData/RNA-Seq/RawData/fastq/test] ********************************************************* THIS ELECTRONIC MAIL MESSAGE AND ANY ATTACHMENT IS CONFIDENTIAL AND MAY CONTAIN LEGALLY PRIVILEGED INFORMATION INTENDED ONLY FOR THE USE OF THE INDIVIDUAL OR INDIVIDUALS NAMED ABOVE. If the reader is not the intended recipient, or the employee or agent responsible to deliver it to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please reply to the sender to notify us of the error and delete the original message. Thank You.