Return-Path: 
 <user-return-35650-apmail-ofbiz-user-archive=ofbiz.apache.org@ofbiz.apache.org>
Delivered-To: apmail-ofbiz-user-archive@www.apache.org
Received: (qmail 59171 invoked from network); 1 Dec 2010 04:42:25 -0000
Received: from unknown (HELO mail.apache.org) (140.211.11.3)
  by 140.211.11.9 with SMTP; 1 Dec 2010 04:42:25 -0000
Received: (qmail 61328 invoked by uid 500); 1 Dec 2010 04:42:25 -0000
Delivered-To: apmail-ofbiz-user-archive@ofbiz.apache.org
Received: (qmail 61049 invoked by uid 500); 1 Dec 2010 04:42:22 -0000
Mailing-List: contact user-help@ofbiz.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@ofbiz.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@ofbiz.apache.org>
List-Post: <mailto:user@ofbiz.apache.org>
List-Id: <user.ofbiz.apache.org>
Reply-To: user@ofbiz.apache.org
Delivered-To: mailing list user@ofbiz.apache.org
Received: (qmail 61041 invoked by uid 99); 1 Dec 2010 04:42:21 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 04:42:21 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of bjfree@free-man.net
 designates 69.94.133.32 as permitted sender)
Received: from [69.94.133.32] (HELO main.free-man.net) (69.94.133.32)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Dec 2010 04:42:16 +0000
Received: from 31.sub-72-102-77.myvzw.com ([72.102.77.31])
          by main.free-man.net (JAMES SMTP Server 2.3.2) with SMTP ID 621
          for <user@ofbiz.apache.org>;
          Tue, 30 Nov 2010 20:38:07 -0800 (PST)
Message-ID: <4CF5D211.4060203@free-man.net>
Date: Tue, 30 Nov 2010 20:41:53 -0800
From: BJ Freeman <bjfree@free-man.net>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US;
 rv:1.9.1.11) Gecko/20100711 Lightning/1.0b1 Thunderbird/3.0.6
MIME-Version: 1.0
To: user@ofbiz.apache.org
Subject: Re: How to import a pre existing product database
References: <001701cb802b$edf0ee50$c9d2caf0$@tofinosoftware.com>
 <AANLkTinsXbtUy7kWBN71efanttfeCv8MO+OUT3EckCUW@mail.gmail.com>
 <4CD9D252.6000304@free-man.net>
 <007601cb8d12$c18c3470$44a49d50$@tofinosoftware.com>
 <4CEF555C.6040408@free-man.net>
 <009601cb9108$aa2309e0$fe691da0$@tofinosoftware.com>
In-Reply-To: <009601cb9108$aa2309e0$fe691da0$@tofinosoftware.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

there should be more to the log that would pinpoint what is going on.
I am guessing it is your input to the form, since this has not been 
changed 09.
if you look at the file mentioned you will see
                <script 
location="component://webtools/webapp/webtools/WEB-INF/actions/datafile/viewdatafile.groovy"/> 
that is where the error referenced.

your xml(not xsd) should have field names as you see them in webtools.
when you have underscores like manufacturer_party_id then that is what 
is in the db but ofbiz will not recognize it in Webtools or code.




James Lawton sent the following on 11/30/2010 7:34 PM:


> I think I am getting closer - thanks for the tips and the patience!
>
> I have been through all the files and here is what I have gotten when running my definition file through the data tools
>
> org.ofbiz.widget.screen.ScreenRenderException: Error rendering screen [component://webtools/widget/MiscScreens.xml#viewdatafile]: groovy.lang.MissingPropertyException: No such property: definitionUrl for class: viewdatafile (No such property: definitionUrl for class: viewdatafile)
>
>
> Here is the xsd file I was running:
>
>
> <data-file name="itemdatabasereport.txt" separator-style="delimited" type-code="UTF-8"
>      delimiter="&#009" text-delimiter=""
>      description="this takes the product data from jeffs file"
>      has-header="true">
>      <record name="Product">
>          <field name="manufacturer_party_id" ignored="false" type="String"/>
>          <field name="productId" ignored="false" type="String"/>
>          <field name="primaryProductCategoryId" expression="true"
>              default-value="tools" type="String"/>
>          <field name="productTypeId" expression="true"
>              default-value="FINISHED_GOOD" type="String"/>
>          <field name="productName" ignored="false" type="String"/>
>          <field name="description" ignored="false" type="String"/>
>          <field name="quantityIncluded" expression="true" default-value="1"
>              type="String"/>
>          <field name="price" ignored="true" type="String"/>
>      </record>
> </data-file>
>
>
> What's wrong with my definition file which is causing the data tool to throw up?
>
> Thanks
> James
>
>
>
> -----Original Message-----
> From: BJ Freeman [mailto:bjfree@free-man.net]
> Sent: November-26-10 1:36 AM
> To: user@ofbiz.apache.org
> Subject: Re: How to import a pre existing product database
>
> I am not clear what you are doing.
> the example you show is for an entity DataImportProduct which does not exist in the OOTB ofbiz take a look at
>
> https://issues.apache.org/jira/browse/OFBIZ-2534
> for tab examples.
> also
> https://issues.apache.org/jira/browse/OFBIZ-2518
>
> =========================
>
> BJ Freeman
> Strategic Power Office with Supplier Automation<http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> Specialtymarket.com<http://www.specialtymarket.com/>  Systems Integrator-- Glad to Assist
>
> Chat  Y! messenger: bjfr33man
> James Lawton sent the following on 11/25/2010 6:36 PM:
>> I am probably doing something stupid here...I have dug into the link
>> that was posted and it looks simple enough...however the code snippet
>> is for a fixed width file rather than a comma delimited file...and my
>> attempts to create the right schema for importing product are
>> failing...If someone has a CSV file snippet to share that would be
>> awesome
>>
>> So heading in a different direction I created the entity data snippet below:
>>
>> <!-- this file contains some sample products for testing the data
>> import routine -->  <entity-engine-xml>
>>
>>       <DataImportProduct productId="YG0081ATF" productTypeId="FINISHED_GOOD" description="1/8 x 1-59/64 CARBIDE DREAM DRILL W/O COOLANT HOLES (3XD)" price="22.13" priceCurrencyUomId="USD" supplierPartyId="YG1" purchasePrice=""/>
>>       <DataImportProduct productId="YG0081BTF"
>> productTypeId="FINISHED_GOOD" description="1/8 x 15/64 CARBIDE DREAM
>> DRILL W/ COOLANT HOLE" price="105.73" priceCurrencyUomId="USD"
>> supplierPartyId="YG1" purchasePrice=""/>
>>
>>
>> </entity-engine-xml>
>>
>> However every time I have tried to use the XML IMport tool it just
>> keeps coming back and saying that the either URL / file or the XML are
>> not complete
>>
>> What am I doing wrong?
>>
>> -----Original Message-----
>> From: BJ Freeman [mailto:bjfree@free-man.net]
>> Sent: November-09-10 6:00 PM
>> To: user@ofbiz.apache.org
>> Subject: Re: How to import a pre existing product database
>>
>> all web tools imports into memory so is limited to the amount of free memory of the sever.
>>
>> I imports files that are gigs in size so read in the files. I typical file has 25 columns and takes about 15min.
>> There is no need to write code to convert files to xml since the
>> https://cwiki.apache.org/confluence/display/OFBENDUSER/OFBiz%27s+Data+
>> File+Tools
>>
>>
>>
>>
>>
>> =========================
>> BJ Freeman
>> Strategic Power Office with Supplier
>> Automation<http://www.businessesnetwork.com/automation/viewforum.php?f
>> =52>  Specialtymarket.com<http://www.specialtymarket.com/>
>> Systems Integrator-- Glad to Assist
>>
>> Chat  Y! messenger: bjfr33man
>> James McGill sent the following on 11/9/2010 12:38 PM:
>>
>>> On Tue, Nov 9, 2010 at 9:34 AM, James Lawton<jamesl@tofinosoftware.com>wrote:
>>>
>>>> How would I import a pre existing product database? I currently have
>>>> it in a CSV and I am looking for a method of getting that
>>>> information into the database so that the imported items will show
>>>> up in the catalog
>>>>
>>>
>>>
>>> OFBiz ETL is best done as XML seed data.
>>> In your scenario I would seriously consider converting the CSV into
>>> XML (a job for Perl), and perhaps doing some input validation as part
>>> of that conversion, and then loading the XML as seed data.
>>>
>>> If you really have a lot of ETL to do (e.g., processing that will
>>> take hours or days to run through the service interface) you might be
>>> better off going straight to the database.  You lose some of the
>>> traceability this way (e.g., logging and event side-effects) so it
>>> isn't recommended.  (We ran into problems when loading in several
>>> years worth of historical data, orders and inventory transactions.)
>>>
>>> --
>>> James McGill
>>> Phoenix AZ
>>>
>>
>>
>>
>
>
>