Return-Path: 
 <user-return-35660-apmail-ofbiz-user-archive=ofbiz.apache.org@ofbiz.apache.org>
Delivered-To: apmail-ofbiz-user-archive@www.apache.org
Received: (qmail 9191 invoked from network); 1 Dec 2010 17:18:11 -0000
Received: from unknown (HELO mail.apache.org) (140.211.11.3)
  by 140.211.11.9 with SMTP; 1 Dec 2010 17:18:11 -0000
Received: (qmail 11731 invoked by uid 500); 1 Dec 2010 17:18:10 -0000
Delivered-To: apmail-ofbiz-user-archive@ofbiz.apache.org
Received: (qmail 11697 invoked by uid 500); 1 Dec 2010 17:18:09 -0000
Mailing-List: contact user-help@ofbiz.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@ofbiz.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@ofbiz.apache.org>
List-Post: <mailto:user@ofbiz.apache.org>
List-Id: <user.ofbiz.apache.org>
Reply-To: user@ofbiz.apache.org
Delivered-To: mailing list user@ofbiz.apache.org
Received: (qmail 11689 invoked by uid 99); 1 Dec 2010 17:18:09 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 17:18:09 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [209.200.245.224] (HELO sm-mail2.lunarbreeze.com)
 (209.200.245.224)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 17:18:03 +0000
Received: from JRLAWTON3 (sm-mail2.hosting.lunarpages.com [127.0.0.1]) by
 sm-mail2.lunarbreeze.com with SMTP;
   Wed, 1 Dec 2010 09:16:35 -0800
From: "James Lawton" <jamesl@tofinosoftware.com>
To: <user@ofbiz.apache.org>
References: <001701cb802b$edf0ee50$c9d2caf0$@tofinosoftware.com>
 <AANLkTinsXbtUy7kWBN71efanttfeCv8MO+OUT3EckCUW@mail.gmail.com>
 <4CD9D252.6000304@free-man.net>
 <007601cb8d12$c18c3470$44a49d50$@tofinosoftware.com>
 <4CEF555C.6040408@free-man.net>
 <009601cb9108$aa2309e0$fe691da0$@tofinosoftware.com>
 <4CF5D211.4060203@free-man.net>
In-Reply-To: <4CF5D211.4060203@free-man.net>
Subject: RE: How to import a pre existing product database
Date: Wed, 1 Dec 2010 12:16:31 -0500
Message-ID: <00db01cb917b$804ee490$80ecadb0$@tofinosoftware.com>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Mailer: Microsoft Outlook 14.0
Thread-Index: 
 AQMtTfuo6axfaRpax9e0HMP4MWUHgwMVTobAAfTg5jEBg536FgGuHRzrAcyBAPMBonqu95BrA0Jg
Content-Language: en-ca
X-Virus-Checked: Checked by ClamAV on apache.org

Thanks

I must be missing the spot in web tools it has a complete list of the =
field names - could you point that out again? For example what is the =
right field name for the manufacturer / supplier? I did take that out =
the db....

Thanks
James

-----Original Message-----
From: BJ Freeman [mailto:bjfree@free-man.net]=20
Sent: November-30-10 11:42 PM
To: user@ofbiz.apache.org
Subject: Re: How to import a pre existing product database

there should be more to the log that would pinpoint what is going on.
I am guessing it is your input to the form, since this has not been =
changed 09.
if you look at the file mentioned you will see
                <script
location=3D"component://webtools/webapp/webtools/WEB-INF/actions/datafile=
/viewdatafile.groovy"/>
that is where the error referenced.

your xml(not xsd) should have field names as you see them in webtools.
when you have underscores like manufacturer_party_id then that is what =
is in the db but ofbiz will not recognize it in Webtools or code.




James Lawton sent the following on 11/30/2010 7:34 PM:


> I think I am getting closer - thanks for the tips and the patience!
>
> I have been through all the files and here is what I have gotten when =
running my definition file through the data tools
>
> org.ofbiz.widget.screen.ScreenRenderException: Error rendering screen =
[component://webtools/widget/MiscScreens.xml#viewdatafile]: =
groovy.lang.MissingPropertyException: No such property: definitionUrl =
for class: viewdatafile (No such property: definitionUrl for class: =
viewdatafile)
>
>
> Here is the xsd file I was running:
>
>
> <data-file name=3D"itemdatabasereport.txt" =
separator-style=3D"delimited" type-code=3D"UTF-8"
>      delimiter=3D"&#009" text-delimiter=3D""
>      description=3D"this takes the product data from jeffs file"
>      has-header=3D"true">
>      <record name=3D"Product">
>          <field name=3D"manufacturer_party_id" ignored=3D"false" =
type=3D"String"/>
>          <field name=3D"productId" ignored=3D"false" type=3D"String"/>
>          <field name=3D"primaryProductCategoryId" expression=3D"true"
>              default-value=3D"tools" type=3D"String"/>
>          <field name=3D"productTypeId" expression=3D"true"
>              default-value=3D"FINISHED_GOOD" type=3D"String"/>
>          <field name=3D"productName" ignored=3D"false" =
type=3D"String"/>
>          <field name=3D"description" ignored=3D"false" =
type=3D"String"/>
>          <field name=3D"quantityIncluded" expression=3D"true" =
default-value=3D"1"
>              type=3D"String"/>
>          <field name=3D"price" ignored=3D"true" type=3D"String"/>
>      </record>
> </data-file>
>
>
> What's wrong with my definition file which is causing the data tool to =
throw up?
>
> Thanks
> James
>
>
>
> -----Original Message-----
> From: BJ Freeman [mailto:bjfree@free-man.net]
> Sent: November-26-10 1:36 AM
> To: user@ofbiz.apache.org
> Subject: Re: How to import a pre existing product database
>
> I am not clear what you are doing.
> the example you show is for an entity DataImportProduct which does not =
exist in the OOTB ofbiz take a look at
>
> https://issues.apache.org/jira/browse/OFBIZ-2534
> for tab examples.
> also
> https://issues.apache.org/jira/browse/OFBIZ-2518
>
> =
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=

>
> BJ Freeman
> Strategic Power Office with Supplier =
Automation<http://www.businessesnetwork.com/automation/viewforum.php?f=3D=
52>
> Specialtymarket.com<http://www.specialtymarket.com/>  Systems =
Integrator-- Glad to Assist
>
> Chat  Y! messenger: bjfr33man
> James Lawton sent the following on 11/25/2010 6:36 PM:
>> I am probably doing something stupid here...I have dug into the link
>> that was posted and it looks simple enough...however the code snippet
>> is for a fixed width file rather than a comma delimited file...and my
>> attempts to create the right schema for importing product are
>> failing...If someone has a CSV file snippet to share that would be
>> awesome
>>
>> So heading in a different direction I created the entity data snippet =
below:
>>
>> <!-- this file contains some sample products for testing the data
>> import routine -->  <entity-engine-xml>
>>
>>       <DataImportProduct productId=3D"YG0081ATF" =
productTypeId=3D"FINISHED_GOOD" description=3D"1/8 x 1-59/64 CARBIDE =
DREAM DRILL W/O COOLANT HOLES (3XD)" price=3D"22.13" =
priceCurrencyUomId=3D"USD" supplierPartyId=3D"YG1" purchasePrice=3D""/>
>>       <DataImportProduct productId=3D"YG0081BTF"
>> productTypeId=3D"FINISHED_GOOD" description=3D"1/8 x 15/64 CARBIDE =
DREAM
>> DRILL W/ COOLANT HOLE" price=3D"105.73" priceCurrencyUomId=3D"USD"
>> supplierPartyId=3D"YG1" purchasePrice=3D""/>
>>
>>
>> </entity-engine-xml>
>>
>> However every time I have tried to use the XML IMport tool it just
>> keeps coming back and saying that the either URL / file or the XML =
are
>> not complete
>>
>> What am I doing wrong?
>>
>> -----Original Message-----
>> From: BJ Freeman [mailto:bjfree@free-man.net]
>> Sent: November-09-10 6:00 PM
>> To: user@ofbiz.apache.org
>> Subject: Re: How to import a pre existing product database
>>
>> all web tools imports into memory so is limited to the amount of free =
memory of the sever.
>>
>> I imports files that are gigs in size so read in the files. I typical =
file has 25 columns and takes about 15min.
>> There is no need to write code to convert files to xml since the
>> =
https://cwiki.apache.org/confluence/display/OFBENDUSER/OFBiz%27s+Data+
>> File+Tools
>>
>>
>>
>>
>>
>> =
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=

>> BJ Freeman
>> Strategic Power Office with Supplier
>> =
Automation<http://www.businessesnetwork.com/automation/viewforum.php?f
>> =3D52>  Specialtymarket.com<http://www.specialtymarket.com/>
>> Systems Integrator-- Glad to Assist
>>
>> Chat  Y! messenger: bjfr33man
>> James McGill sent the following on 11/9/2010 12:38 PM:
>>
>>> On Tue, Nov 9, 2010 at 9:34 AM, James =
Lawton<jamesl@tofinosoftware.com>wrote:
>>>
>>>> How would I import a pre existing product database? I currently =
have
>>>> it in a CSV and I am looking for a method of getting that
>>>> information into the database so that the imported items will show
>>>> up in the catalog
>>>>
>>>
>>>
>>> OFBiz ETL is best done as XML seed data.
>>> In your scenario I would seriously consider converting the CSV into
>>> XML (a job for Perl), and perhaps doing some input validation as =
part
>>> of that conversion, and then loading the XML as seed data.
>>>
>>> If you really have a lot of ETL to do (e.g., processing that will
>>> take hours or days to run through the service interface) you might =
be
>>> better off going straight to the database.  You lose some of the
>>> traceability this way (e.g., logging and event side-effects) so it
>>> isn't recommended.  (We ran into problems when loading in several
>>> years worth of historical data, orders and inventory transactions.)
>>>
>>> --
>>> James McGill
>>> Phoenix AZ
>>>
>>
>>
>>
>
>
>