Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 35069C9CD for ; Wed, 6 Jun 2012 17:57:14 +0000 (UTC) Received: (qmail 36719 invoked by uid 500); 6 Jun 2012 17:57:14 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 36687 invoked by uid 500); 6 Jun 2012 17:57:14 -0000 Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@oodt.apache.org Delivered-To: mailing list dev@oodt.apache.org Received: (qmail 36585 invoked by uid 99); 6 Jun 2012 17:57:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jun 2012 17:57:13 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS,TVD_RCVD_SPACE_BRACKET X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [128.149.139.109] (HELO mail.jpl.nasa.gov) (128.149.139.109) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jun 2012 17:57:06 +0000 Received: from jpl.nasa.gov (localhost [127.0.0.1]) by smtp.jpl.nasa.gov (Sentrion-MTA-4.2.2/Sentrion-MTA-4.2.2) with ESMTP id q56HtgVe021352; Wed, 6 Jun 2012 10:56:43 -0700 Received: from mail.jpl.nasa.gov ([ap-ehub-sp02.jpl.nasa.gov [128.149.137.149]]) by mail.jpl.nasa.gov with RELAY id q56HuBeT021797 ; Wed, 6 Jun 2012 10:56:15 -0700 Received: from AP-EMBX-SP20.RES.AD.JPL ([169.254.8.233]) by ap-ehub-sp02.RES.AD.JPL ([fe80::dd85:7b07:1e36:7e3c%15]) with mapi id 14.02.0298.004; Wed, 6 Jun 2012 10:56:12 -0700 From: "Mattmann, Chris A (388J)" To: "" CC: "user@oodt.apache.org" , "" Subject: Re: [oodt-dev] Limitation using Oracle as Data Source for File Manager Thread-Topic: [oodt-dev] Limitation using Oracle as Data Source for File Manager Thread-Index: AQHNQpdh6RQOZ7AARkuWOZ28V6fCAJbrKviAgAAIVACAAG2oAIAAk+GAgAHT3oCAAALGAA== Date: Wed, 6 Jun 2012 17:56:11 +0000 Message-ID: <25B8F9BD-7907-4D42-8683-1848439CD749@jpl.nasa.gov> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [128.149.137.114] Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Source-Sender: chris.a.mattmann@jpl.nasa.gov X-AUTH: Authorized Hi Cynthia, Did you check out the inheritance hierarchy for the MappedDataSourceCatalog= in code? I believe it sub-classes DataSourceCatalog, so therein lies the answer. I'm assuming also that you are talking about the to-be-contributed work in = OODT-393 [1] that Michael Starch proposed. That hasn't been contributed to Apache yet, b= ut I think Michael is working on it. You may want to comment on that issue and ping hi= m. Thanks! Cheers, Chris [1] http://issues.apache.org/jira/browse/OODT-393 On Jun 6, 2012, at 10:46 AM, Wong, Cynthia L (388J) wrote: > Chris, >=20 > Another question comes up. If I apply MappedDataSourceCatalog, will this > work with the flat database tables implementation aka > ColumnBasedDataSourceCatalog? >=20 > Thanks, > Cynthia >=20 >=20 >=20 > On 6/5/12 6:51 AM, "Wong, Cynthia L (388J)" > wrote: >=20 >> Chris, >>=20 >> Thank you for looking up the information. This does provide a solution >> that I'm looking for. >>=20 >> Cynthia >>=20 >> On 6/4/12 10:03 PM, "Mattmann, Chris A (388J)" >> wrote: >>=20 >>> [cc /Apache lists] >>>=20 >>> Hey Cynthia, >>>=20 >>> See this file:=20 >>>=20 >>> http://s.apache.org/Tds >>>=20 >>> Pretty self-explanatory really. The left side is the Product Type name >>> and the right >>> side of the equals sign is the mapped Oracle table name. If you define = a >>> mapping >>> in this file it will be used, otherwise the default >>> ProductTypeName_reference >>> and ProductTypeName_metadata will be used. >>>=20 >>> To enable the catalog, per http://s.apache.org/Jkh >>>=20 >>> Change: >>>=20 >>> # catalog factory >>> filemgr.catalog.factory=3Dorg.apache.oodt.cas.filemgr.catalog.LuceneCat= alog >>> F >>> actory >>>=20 >>> to: >>>=20 >>> # catalog factory >>> filemgr.catalog.factory=3Dorg.apache.oodt.cas.filemgr.catalog.MappedDat= aSou >>> r >>> ceCatalogFactory >>>=20 >>> And then set: >>>=20 >>> # mapped data source catalog configuration >>> org.apache.oodt.cas.filemgr.catalog.mappeddatasource.mapFile=3D/path/to= /ops >>> . >>> catalog.typemap.properties >>>=20 >>> The existing data source properties (JDBC url, etc.) will be inherited >>> from the default >>> DataSourceCatalog properties. >>>=20 >>> HTH! >>>=20 >>> Cheers, >>> Chris >>>=20 >>>=20 >>> On Jun 4, 2012, at 3:29 PM, Wong, Cynthia L (388J) wrote: >>>=20 >>>> Chris, >>>>=20 >>>> That's good to know. Is there any example that shows how to use and se= t >>>> up >>>> MappedDataSourceCatalog? However, we actually would like to avoid >>>> maintaining the mapping. Can we apply MappedDataSourceCatalog only to >>>> the >>>> long product type names and not other types? >>>>=20 >>>> Thanks, >>>> Cynthia >>>>=20 >>>>=20 >>>>=20 >>>> On 6/4/12 3:00 PM, "Mattmann, Chris A (388J)" >>>> wrote: >>>>=20 >>>>> Hi Cynthia, >>>>>=20 >>>>> Scope out the MappedDataSourceCatalog :) >>>>>=20 >>>>> It will get you around this... >>>>>=20 >>>>> Cheers, >>>>> Chris >>>>>=20 >>>>> On Jun 4, 2012, at 2:17 PM, Wong, Cynthia L (388J) wrote: >>>>>=20 >>>>>> Hello, all, >>>>>>=20 >>>>>> We've recently switched from MySQL to Oracle. Migrating the File >>>>>> Catalog from MySQL to Oracle has triggered a problem. Oracle has a >>>>>> limitation of 30 characters for table names. File Manager's >>>>>> implementation assign table names as the following: >>>>>>=20 >>>>>> [Product Type Name]_REFERENCE for tracking location references of th= e >>>>>> stored files >>>>>> [Product Type Name]_METADATA for metadata about stored files >>>>>>=20 >>>>>> Note that "_REFERENCE" contains 10 characters already and therefore >>>>>> there is a limitation of 20 characters for ProductTypeName. I'm >>>>>> wondering if anyone has encountered this restriction. Is there a >>>>>> workaround? >>>>>>=20 >>>>>> Thanks, >>>>>> Cynthia >>>>>>=20 >>>>>>=20 >>>>>=20 >>>>>=20 >>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>> Chris Mattmann, Ph.D. >>>>> Senior Computer Scientist >>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>>>> Office: 171-266B, Mailstop: 171-246 >>>>> Email: chris.a.mattmann@nasa.gov >>>>> WWW: http://sunset.usc.edu/~mattmann/ >>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>> Adjunct Assistant Professor, Computer Science Department >>>>> University of Southern California, Los Angeles, CA 90089 USA >>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>=20 >>>>>=20 >>>>=20 >>>>=20 >>>=20 >>>=20 >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>> Chris Mattmann, Ph.D. >>> Senior Computer Scientist >>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA >>> Office: 171-266B, Mailstop: 171-246 >>> Email: chris.a.mattmann@nasa.gov >>> WWW: http://sunset.usc.edu/~mattmann/ >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>> Adjunct Assistant Professor, Computer Science Department >>> University of Southern California, Los Angeles, CA 90089 USA >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>=20 >>>=20 >>=20 >=20 >=20 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattmann@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++