I have a situation where I am using the ddlutils API for postgres, and I add a bunch of columns
in a table (nullable, no default value), and it creates a temporary table.  I look in ddlutils
and the source code is completely different from the latest stable jar... when is the next
version being released so I can see if the issue exists in the latest code?

Thanks,
Chris



________________________________
From: Rasha <rasha.abdallah@murex.com>
To: ddlutils-user@db.apache.org
Sent: Thu, October 29, 2009 11:38:03 AM
Subject: Why DDLUtils keeps create temporary tables even when operation is allowed in Driver


Hi, 

I was searching the mailing list for an explanation on why DDLUtils attempt
to resolve most operations by creating a temporary table, migrating data to
it, dropping and recreating original column. 
According to the post in
http://www.nabble.com/Plataform.getAlterTablesSql-results-ts4864470.html#a4864470 
This should happen only if the implementation does not support the requested
operation. 

In my case, I am using a Derby database, and I am attempting to do a
ColumnRequiredChange 

Original Table:
<table name="author">
    <column name="author_id" type="INTEGER" primaryKey="true" required="true"
/>
    <column name="author_name" type="VARCHAR" size="50" required="true" />
    <column name="organisation" type="VARCHAR" size="50" required="true" />
</table>


Desired Model 

<table name="author">
    <column name="author_id" type="INTEGER" primaryKey="true" required="true"
/>
    <column name="author_name" type="VARCHAR" size="50" required="true" />
    <column name="organisation" type="VARCHAR" size="50" required="false" />
</table>

I do not understand why in this case, the table is being dropped and
recreated. 
Although derby supports doing 

alter table author
alter organisation null


Thanks for your help 
Rasha

-- 
View this message in context: http://www.nabble.com/Why-DDLUtils-keeps-create-temporary-tables-even-when-operation-is-allowed-in-Driver-tp26116530p26116530.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.


      

Hi, 

I was searching the mailing list for an explanation on why DDLUtils attempt
to resolve most operations by creating a temporary table, migrating data to
it, dropping and recreating original column. 
According to the post in
http://www.nabble.com/Plataform.getAlterTablesSql-results-ts4864470.html#a4864470 
This should happen only if the implementation does not support the requested
operation. 

In my case, I am using a Derby database, and I am attempting to do a
ColumnRequiredChange 

Original Table:
<table name="author">
	<column name="author_id" type="INTEGER" primaryKey="true" required="true"
/>
	<column name="author_name" type="VARCHAR" size="50" required="true" />
	<column name="organisation" type="VARCHAR" size="50" required="true" />
</table>


Desired Model 

<table name="author">
	<column name="author_id" type="INTEGER" primaryKey="true" required="true"
/>
	<column name="author_name" type="VARCHAR" size="50" required="true" />
	<column name="organisation" type="VARCHAR" size="50" required="false" />
</table>

I do not understand why in this case, the table is being dropped and
recreated. 
Although derby supports doing 

alter table author
alter organisation null


Thanks for your help 
Rasha

-- 
View this message in context: http://www.nabble.com/Why-DDLUtils-keeps-create-temporary-tables-even-when-operation-is-allowed-in-Driver-tp26116530p26116530.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

Hi,

there should be no limits other than what the file system allows
(which should be way above 63MB). You could try bumping up the log
verbosity (via the verbosity parameter if you're using the Ant tasks)
to see if you get more details on what the problem is.

Tom

On Wed, Sep 30, 2009 at 04:28, Thylex <thylex@gmail.com> wrote:
> Hi all,
>
> I'm trying to use ddlutils to move a database from MySQL to Derby. The
> schema XML file gets written just fine and looks OK, but it seems that the
> export stops when the data-XML reaches around 63 MB in size. It stops in the
> middle of a record without finishing that record. A check with wc shows the
> XML file to have 636268 lines in it and 65.334.602 characters.
> Since it stops in the middle of a record I get the feel that it runs into
> some form of size limit, so...
>
> Are there limits to the size of the XML export files?
>
> I've tried with DdlUtils-1.0.jar from the download section, and I also tried
> building one from the SVN trunk with the same result.
>
>
> Best regards
>
> Henrik Svensson
>

Hi all,

I'm trying to use ddlutils to move a database from MySQL to Derby. The
schema XML file gets written just fine and looks OK, but it seems that the
export stops when the data-XML reaches around 63 MB in size. It stops in the
middle of a record without finishing that record. A check with wc shows the
XML file to have 636268 lines in it and 65.334.602 characters.
Since it stops in the middle of a record I get the feel that it runs into
some form of size limit, so...

Are there limits to the size of the XML export files?

I've tried with DdlUtils-1.0.jar from the download section, and I also tried
building one from the SVN trunk with the same result.


Best regards

Henrik Svensson

Hi everybody,

similar to other posts
(http://www.nabble.com/problem-writing-sql-to-file-td3876914.html#a3876914,
http://www.nabble.com/No-output-from-writeSchemaSqlTofile-command-td17453074.html#a17516352),
<writeschemasqltofile> creates a blank file. As recommended i set
alterdatabase="false" without any effect. I tried to convert the generated
xml to sql using <ddlToDatabase>, without success. My Ant-Target looks like
this:

	<target name="database-dump" description="Create dump">

	  <mkdir dir="${out.dir}" />
		
	  <taskdef name="databaseToDdl"
classname="org.apache.ddlutils.task.DatabaseToDdlTask" />
		
	  <databaseToDdl modelname="MyModel" verbosity="debug"
databasetype="oracle9" 
	  	usedelimitedsqlidentifiers="true" tabletypes="TABLE"
schemapattern="MySchema">
	  	
	    <database url="jdbc:oracle:thin:@[host]:1521:orcl"
	            driverClassName="oracle.jdbc.OracleDriver"
	            username="[usr]"
	            password="[pwd]"
	    		initialsize="5"
	    		testonborrow="true"
	    		testonreturn="true"/>
	  	
	  	<writeschemasqltofile failonerror="false"
outputfile="${out.dir}/schema.sql"/>
	    <writeSchemaToFile failonerror="false"
outputFile="${out.dir}/schema.xml"/>
	  </databaseToDdl>

	</target>

The XML file is created properly.

Does anybody have an idea?

Thanks in advance!

Cheers,

GLA


-- 
View this message in context: http://www.nabble.com/writeschemasqltofile-creates-blank-file-tp25330367p25330367.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

Dear all,

I would like to move a database schema (and data) from MySQL to Derby.
Things work very well but there remains one little challenge.

I would like to rename the column the target-database.

Calling
   targetPlatform.alterModel()
after inserting the data,  recreates the table, loosing the data.

A simple
   model.findTable( "table1" ).findColumn( "col1" ).setName( "colXXX" );
does not help neither:
      - or the sourceModel can't fetch from the source database anymore
      - or the targetModel doesn't match the datafile anymore

Does anybody know about an API feature I didn't find yet?

Thank you!
J.

Hi!

I'm using ddlutils (1.0) and mysql (5.0.67)

I'm using this ant buildfile:

<?xml version="1.0"?>
<project name="" basedir=".">
  <path id="classpath">
    <fileset dir="./lib">
      <include name="**/*.jar" />
    </fileset>
  </path>
  <target name="export-source-db"
  description="Dumps db structure and data">
    <taskdef name="databaseToDdl"
    classname="org.apache.ddlutils.task.DatabaseToDdlTask">
      <classpath refid="classpath" />
    </taskdef>
    <databaseToDdl modelName="MigrateTest" databasetype="mysql5" >
      <database url="jdbc:mysql://localhost/forexport"
      driverClassName="com.mysql.jdbc.Driver" username="root"
      password="" />
      <writeSchemaToFile outputFile="db-schema.xml" />
      <writeDataToFile outputFile="data.xml" />
    </databaseToDdl>
  </target>
  <target name="import-target-db"
  description="Creates db and loads data" >
    <taskdef name="ddlToDatabase"
    classname="org.apache.ddlutils.task.DdlToDatabaseTask">
      <classpath refid="classpath" />
    </taskdef>
    <ddlToDatabase schemaFile="db-schema.xml" databasetype="mysql5"
verbosity="debug">
      <database url="jdbc:mysql://localhost/dbstufftest"
      driverClassName="com.mysql.jdbc.Driver"
      username="root" password="" />
     <!-- <createDatabase failonerror="false" /> -->
      <writeSchemaToDatabase />
      <writeDataToDatabase datafile="data.xml" />
    </ddlToDatabase>
  </target>
</project>


When i try to execute import-target-db after if exported the data I get the
following error:

[ddlToDatabase] SQL Command CREATE UNIQUE INDEX PRIMARY ON campaign_users
(campaign_id, user_id) failed with: You have an error in your SQL syntax;
check the manual that corresponds to your MySQL serv
er version for the right syntax to use near 'PRIMARY ON campaign_users
(campaign_id, user_id)' at line 1

Do you have any ideas?
-- 
View this message in context: http://www.nabble.com/Error-while-executing-SQL-CREATE-UNIQUE-INDEX-PRIMARY-ON-tp24607554p24607554.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

Dear all,

i face a strange problem.
We try to migrate/update a schema using ddlutils with oracle 10.1.0.2 (on
windows)
During migration we get  ORA-01578: ORACLE data block corrupted
Further examination showed that an primary key index of a newly created
table (ipd_lre_)
was corrupted. This tables has been created by ddlutils and the data from
ipd_lre
was being copied incompletely to this table.
ipd_lre contained about 50000 lines at the beginning.
After recreating the corrupted index  and starting the migration again (4
times).
It finish, but all rows were eliminated.

We could not identify any disk or i/o problems.

We created a new tablespace/datafile and imported the schema.
The problem was reproduced, again the corruption error ocured.

ipd_lre has a primary key using to columns
ipd_lre has also clob data columns

We use an oracle 11 thin jdbc driver.

Of course there are lots of different ways to try?
But what do you think is the most promising?
Anyone who had similar problems?

Thanks
Stefan Schmitz-Linneweber

-- 
View this message in context: http://www.nabble.com/migration-leads-to-ORACLE-data-block-corrupted-tp23761958p23761958.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

I am trying to find out if DdlUtils contains support for views, stored
procedures, triggers, packages, synonyms and privileges.

 

Mark

 

Done; DDLUTILS-242 and DDLUTILS-243.

Thomas Dudziak wrote:
> On Tue, Mar 24, 2009 at 9:50 PM, Rusty Wright <rusty.wright@gmail.com> wrote:
>> Thanks; I didn't see that.
>>
>> 1) I still think it would be nice if the format could be documented on the
>> ddlutils web site, obviously in a non-specific way but also with a specific
>> simple example.  It seems to me that it's very similar to DbUnit's
>> non-verbose format so you could use their explanation as a starting point.
> 
> Sure. Could you file a JIRA ticket for that ?
> 
>> 2) The documentation for writeDtdToFile says "This sub task does not require
>> a database connection, so the dataSource sub element of the enclosing task
>> can be omitted." which is incorrect, it does require a connection, and, to
>> split hairs over terminology, it should say "database sub element" instead
>> "dataSource sub element" since the xml tag it's referring to is <database>
>> and not <dataSource>.
> 
> The writeDtdToFile sub task is also available in the ddlToDatabase
> task and I think that task doesn't require a DB connection.
> 
> Tom

On Tue, Mar 24, 2009 at 9:50 PM, Rusty Wright <rusty.wright@gmail.com> wrote:
> Thanks; I didn't see that.
>
> 1) I still think it would be nice if the format could be documented on the
> ddlutils web site, obviously in a non-specific way but also with a specific
> simple example.  It seems to me that it's very similar to DbUnit's
> non-verbose format so you could use their explanation as a starting point.

Sure. Could you file a JIRA ticket for that ?

> 2) The documentation for writeDtdToFile says "This sub task does not require
> a database connection, so the dataSource sub element of the enclosing task
> can be omitted." which is incorrect, it does require a connection, and, to
> split hairs over terminology, it should say "database sub element" instead
> "dataSource sub element" since the xml tag it's referring to is <database>
> and not <dataSource>.

The writeDtdToFile sub task is also available in the ddlToDatabase
task and I think that task doesn't require a DB connection.

Tom

The dbUnit format I'm thinking of is their FlatXmlDataSet;

  http://dbunit.sourceforge.net/components.html

But it's not as similar as I thought, but their description still could provide a starting
point.  (I much prefer their XmlDataSet format.)

Re-reading their documentation made me wonder, can you specify nulls with ddlUtils' data file
format?


Rusty Wright wrote:
> Thanks; I didn't see that.
> 
> 1) I still think it would be nice if the format could be documented on 
> the ddlutils web site, obviously in a non-specific way but also with a 
> specific simple example.  It seems to me that it's very similar to 
> DbUnit's non-verbose format so you could use their explanation as a 
> starting point.
> 
> 2) The documentation for writeDtdToFile says "This sub task does not 
> require a database connection, so the dataSource sub element of the 
> enclosing task can be omitted." which is incorrect, it does require a 
> connection, and, to split hairs over terminology, it should say 
> "database sub element" instead "dataSource sub element" since the xml 
> tag it's referring to is <database> and not <dataSource>.
> 
> Thanks again.
> 
> 
> Thomas Dudziak wrote:
>> On Tue, Mar 24, 2009 at 1:26 PM, Rusty Wright <rusty.wright@gmail.com> 
>> wrote:
>>
>>> No, sorry, that doesn't help.  I looked again on the torque site and 
>>> can't
>>> find the documentation for the data load file.
>>>
>>> The two urls you gave are for the database schema; I'm asking about 
>>> the data
>>> file where you load data into the database using the writeDataToDatabase
>>> tag, after it's created the tables.
>>>
>>> I managed to figure it out by searching the mailing list archives, 
>>> but it
>>> seems quite odd to me that it's apparently completely undocumented.
>>
>> The format for the data file is not fixed, it depends on the schema.
>> There is an Ant task that will generate a data file DTD for a
>> particular schema:
>>
>> http://db.apache.org/ddlutils/ant/org.apache.ddlutils.task.WriteDtdToFileCommand.html

>>
>>
>> Tom

Thanks; I didn't see that.

1) I still think it would be nice if the format could be documented on the ddlutils web site,
obviously in a non-specific way but also with a specific simple example.  It seems to me that
it's very similar to DbUnit's non-verbose format so you could use their explanation as a starting
point.

2) The documentation for writeDtdToFile says "This sub task does not require a database connection,
so the dataSource sub element of the enclosing task can be omitted." which is incorrect, it
does require a connection, and, to split hairs over terminology, it should say "database sub
element" instead "dataSource sub element" since the xml tag it's referring to is <database>
and not <dataSource>.

Thanks again.


Thomas Dudziak wrote:
> On Tue, Mar 24, 2009 at 1:26 PM, Rusty Wright <rusty.wright@gmail.com> wrote:
> 
>> No, sorry, that doesn't help.  I looked again on the torque site and can't
>> find the documentation for the data load file.
>>
>> The two urls you gave are for the database schema; I'm asking about the data
>> file where you load data into the database using the writeDataToDatabase
>> tag, after it's created the tables.
>>
>> I managed to figure it out by searching the mailing list archives, but it
>> seems quite odd to me that it's apparently completely undocumented.
> 
> The format for the data file is not fixed, it depends on the schema.
> There is an Ant task that will generate a data file DTD for a
> particular schema:
> 
> http://db.apache.org/ddlutils/ant/org.apache.ddlutils.task.WriteDtdToFileCommand.html
> 
> Tom

On Tue, Mar 24, 2009 at 1:26 PM, Rusty Wright <rusty.wright@gmail.com> wrote:

> No, sorry, that doesn't help.  I looked again on the torque site and can't
> find the documentation for the data load file.
>
> The two urls you gave are for the database schema; I'm asking about the data
> file where you load data into the database using the writeDataToDatabase
> tag, after it's created the tables.
>
> I managed to figure it out by searching the mailing list archives, but it
> seems quite odd to me that it's apparently completely undocumented.

The format for the data file is not fixed, it depends on the schema.
There is an Ant task that will generate a data file DTD for a
particular schema:

http://db.apache.org/ddlutils/ant/org.apache.ddlutils.task.WriteDtdToFileCommand.html

Tom

No, sorry, that doesn't help.  I looked again on the torque site and can't find the documentation
for the data load file.

The two urls you gave are for the database schema; I'm asking about the data file where you
load data into the database using the writeDataToDatabase tag, after it's created the tables.

I managed to figure it out by searching the mailing list archives, but it seems quite odd
to me that it's apparently completely undocumented.


Rijk van Haaften wrote:
> 2009/3/24 Rusty Wright <rusty.wright@gmail.com>:
>> Where is the documentation for the format of the data file that's used by
>> the  writeDataToDatabase command?
> In the menu, I see "The XML schema format", leading to
>     http://db.apache.org/ddlutils/schema/database.dtd.html
> and
>     http://db.apache.org/ddlutils/schema/database.dtd.org.html
> ?
> 
> Moreover, from the documentation on the main page
> (http://db.apache.org/ddlutils/),
> "DdlUtils uses the Turbine XML format, which is shared by Torque and OJB."
> You can look in the documentation of those projects for information about
> the xml format too.
> 
> Does that help enough?
> 
> Rijk van Haaften

2009/3/24 Rusty Wright <rusty.wright@gmail.com>:
> Where is the documentation for the format of the data file that's used by
> the  writeDataToDatabase command?
In the menu, I see "The XML schema format", leading to
    http://db.apache.org/ddlutils/schema/database.dtd.html
and
    http://db.apache.org/ddlutils/schema/database.dtd.org.html
?

Moreover, from the documentation on the main page
(http://db.apache.org/ddlutils/),
"DdlUtils uses the Turbine XML format, which is shared by Torque and OJB."
You can look in the documentation of those projects for information about
the xml format too.

Does that help enough?

Rijk van Haaften

Where is the documentation for the format of the data file that's used by the  writeDataToDatabase
command?  I've looked on
http://db.apache.org/ddlutils/ant/org.apache.ddlutils.task.WriteDataToDatabaseCommand.html
and
http://db.apache.org/ddlutils/api/org/apache/ddlutils/task/WriteDataToDatabaseCommand.html
but I can't find it anywhere.  It seems to be cleverly hidden somewhere that I'm not looking.

On Mon, Jan 26, 2009 at 12:11 AM, pmendelson2 <mendelson.paul@gmail.com> wrote:

> I would like to use ddlutils to seed and capture data from an h2 database.  I
> see that support for H2 is slotted for release 1.3.  I also see that there
> is a major 1.1 release that simplifies the dbms plugin mechanism.
>
> If I need to use DDLUtils with h2 today which branch should I download and
> try to hack into?

You should checkout trunk, and start with copying the hsqldb platform
classes which should be relatively similar. The steps then would be

* get the unit tests running against an H2 database
* fix the broken unit tests one by one

For the purpose of the above, it is easier to work with an external H2
database server instead of using it embedded.

hope that helps,
Tom

I would like to use ddlutils to seed and capture data from an h2 database.  I
see that support for H2 is slotted for release 1.3.  I also see that there
is a major 1.1 release that simplifies the dbms plugin mechanism.

If I need to use DDLUtils with h2 today which branch should I download and
try to hack into?
-- 
View this message in context: http://www.nabble.com/Using-DDLUtils-with-h2database-tp21658131p21658131.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

Hi all,

In writeDataToFile's document, I don't see any nested elements to specify
which tables the data should be dumped from.
Is there a way (and how) to export data from just certain tables ??

Besides, I am not sure if the previous help requesting email got through.
Let me post it again.

Instead of exporting all tables, I tried to just export certain tables out
of a DB.
I read through DdlUtils' web page and still don't have any clue on how to
use "TableSpecificParameter".

Followings are the sneppits of my XML and the result of execution:
Maybe I didn't understand the material right, please correct me.

     17             <writeSchemaToFile outputFile="db-schema.xml">
     18                 <tableSpecificParameter table="foak_user_profile"/>
     19             </writeSchemaToFile>
BUILD FAILED
[blah] writeSchemaToFile doesn't support the nested "tableSpecificParameter"
element.

     17             <writeSchemaToFile outputFile="db-schema.xml">
     18                 <parameter table="user_profile"/>
     19             </writeSchemaToFile>
BUILD FAILED
[blah] writeSchemaToFile doesn't support the nested "parameter" element

-- 
This is a UTF-8 formatted mail
-----------------------------------------------
James C.-C.Yu
+886988713275

Hi All,

I'm trying to do a schema export from my database but I keep getting 
this error.

db.xml:16: Could not read the schema from the specified database: 
Database type Oracle is not supported.

Here is my ant file:

<project default="database-dump">
<path id="runtime-classpath">
  <fileset dir="../public_html/WEB-INF/lib">
    <include name="*.jar"/>
  </fileset>
</path>
<target name="database-dump" description="Dumps the database structure">
  <taskdef name="databaseToDdl"
           classname="org.apache.ddlutils.task.DatabaseToDdlTask">
    <classpath refid="runtime-classpath"/>
  </taskdef>
  <databaseToDdl verbosity="DEBUG" modelName="MyModel"  >
    <database url="jdbc:oracle:thin:@localhost:1521:dev5"
              driverClassName="oracle.jdbc.OracleDriver"
              username="cpc"
              password="cpc"/>

    <writeSchemaToFile outputFile="db-schema.xml"/>
  </databaseToDdl>
</target>
</project>


Does anyone know why this might be happening?  What am I doing wrong?


Mark

-- 
Mark Robinson - Mizar LLC
mark.robinson@mizar.com
111-1010 McKenzie Ave.
Victoria, BC
V8X 4B2
(250) 588-8321

On Fri, Jan 2, 2009 at 1:03 AM, Marcel Wagner <marcel.wagner@gmx.de> wrote:

> I have some trouble with DdlUtils 1.0 and also trunk. I can't get BLOB data
> imported. I always get
>
> Caused by: java.sql.SQLException: Connection is closed.
>   at
> org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.checkOpen(PoolingDataSource.java:175)
>   at
> org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.close(PoolingDataSource.java:180)
>   at
> org.apache.ddlutils.io.DataToDatabaseSink.end(DataToDatabaseSink.java:217)
>   ... 19 more
>
> As an attachment the schema and data, where the exception occures. Any idea,
> what is the problem??? Verified with MySql and DerbyDB

This error looks like the connection timed out on the database side.
How is the data source configured ? Do you have a validation query ?

Tom

Hi,

I have some trouble with DdlUtils 1.0 and also trunk. I can't get BLOB 
data imported. I always get

Caused by: java.sql.SQLException: Connection is closed.
    at 
org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.checkOpen(PoolingDataSource.java:175)
    at 
org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.close(PoolingDataSource.java:180)
    at 
org.apache.ddlutils.io.DataToDatabaseSink.end(DataToDatabaseSink.java:217)
    ... 19 more

As an attachment the schema and data, where the exception occures. Any 
idea, what is the problem??? Verified with MySql and DerbyDB

Thanks for the help,

Marcel

Hi Heng,

please file an issue with DdlUtils JIRA
(http://issues.apache.org/jira/secure/BrowseProject.jspa?id=10731) for
this. If you have a patch or unit tests for this, please also attach
them to the JIRA issue.

thanks,
Tom

On Wed, Nov 26, 2008 at 8:30 AM, Heng Chu <hengchu@hotmail.com> wrote:
>
> First of all, thanks for this wonderful utility. Very useful w/ a lot of good
> features. I recently found a problem in ddlutils (latest code in SVN) and
> have a fix. I am not sure how I can contribute the fix back to the DdlUtils
> project team.
>
> Here is the problem: I use excludetables in the DdlUtils Ant task
> org.apache.ddlutils.task.DatabaseToDdlTask. Some of the tables listed have
> foreigh keys to other tables in the DB. I got an error on writeSchemaToFile
> complaining about this which should be ok.
>
> Here is the fix: In org.apache.ddlutils.task.DatabaseToDdlTask, the
> readModel() method calls the
> ModelHelper.checkForForeignKeysToAndFromTables() in both the exclude and
> include cases. That method, as currently implemented, throws an exception if
> (1) a table in the (exclude or include) list has a foreign key to a table
> not on the list, OR, (2) a table not on the list has a foreign key into a
> table in the (exclude or include) list. This is too strict a check and could
> stop some legit cases -- my problem is actually due to chec (1) which is ok
> in exclude case. This method should be split into two. For the include case,
> just check (1) and for excluse case, just check (2). I made the
> straightfoward change in my local copy and things went ok. I just want to
> report this and hope it's fixed in the near future. Thanks!
>
> Heng
> --
> View this message in context: http://www.nabble.com/excludetables-problem-and-have-a-fix-tp20704354p20704354.html
> Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.
>
>

First of all, thanks for this wonderful utility. Very useful w/ a lot of good
features. I recently found a problem in ddlutils (latest code in SVN) and
have a fix. I am not sure how I can contribute the fix back to the DdlUtils
project team. 

Here is the problem: I use excludetables in the DdlUtils Ant task
org.apache.ddlutils.task.DatabaseToDdlTask. Some of the tables listed have
foreigh keys to other tables in the DB. I got an error on writeSchemaToFile
complaining about this which should be ok. 

Here is the fix: In org.apache.ddlutils.task.DatabaseToDdlTask, the
readModel() method calls the
ModelHelper.checkForForeignKeysToAndFromTables() in both the exclude and
include cases. That method, as currently implemented, throws an exception if
(1) a table in the (exclude or include) list has a foreign key to a table
not on the list, OR, (2) a table not on the list has a foreign key into a
table in the (exclude or include) list. This is too strict a check and could
stop some legit cases -- my problem is actually due to chec (1) which is ok
in exclude case. This method should be split into two. For the include case,
just check (1) and for excluse case, just check (2). I made the
straightfoward change in my local copy and things went ok. I just want to
report this and hope it's fixed in the near future. Thanks!

Heng
-- 
View this message in context: http://www.nabble.com/excludetables-problem-and-have-a-fix-tp20704354p20704354.html
Sent from the Apache DdlUtils - User mailing list archive at Nabble.com.

Hi,

i have a problem exporting the database structure of ONE schema (called ags) from a db2 database
(v8) via ant.
The database contains different schemata. If I set the schemapattern parameter to "ags" the
result is an empty .xml oder *.sql file.
if i don´t set the parameter, the task tries to receive data form all tables of all schemas,
but
appends the username "extranet" instead of the right schema prefix. which leads to an error
as this schema doesnt exist and the tables 
are realy in other schemas.

C:\sources\ags_extranet\build.xml:299: Could not read the schema from the specified database:
COM.ibm.db2.jdbc.DB2Exception: 
[IBM][CLI Driver][DB2/NT] SQL0204N  "EXTRANET.ACT_DYN_DATE_CURVE" ist ein nicht definierter
Name.  SQLSTATE=42704

("ist ein nicht definierter Name" german for non-defined name)

if anybody has an idea, i would be very thankfull!

wbr
jens ihrig

<target name="dump-database" description="Dumps the database structure">  
		
		<echo message="Dump the database structure"/>
		
		<tstamp>
			<format property="fileNamePrefix" pattern="yyyy-MM-dd_HH-mm-ss_" />
		</tstamp>	
		
		<echo message="using java libraries from: ${java.lib.path}"/>

		<path id="runtime-classpath">
		  <fileset dir="${java.lib.path}">
		    <include name="**/*.jar"/>
		    <include name="**/*.zip"/>
		  </fileset>
		</path>	

		<taskdef classname="org.apache.ddlutils.task.DatabaseToDdlTask"
		           name="databaseToDdl"
		           classpathref="runtime-classpath" 
		 />
	
		<databaseToDdl 
			verbosity="DEBUG"  
			modelname="ags"
			tabletypes="TABLE"
			schemapattern="ags"	
		>
			    <database	url="jdbc:db2:ags_ex"
			              	driverClassName="COM.ibm.db2.jdbc.app.DB2Driver"
			              	username="extranet"
			              	password="********"
			    />

			    <writeSchemaToFile outputFile="${database-dump.path}${fileNamePrefix}db_schema.xml"/>
			<writeSchemaSqlToFile outputFile="${database-dump.path}${fileNamePrefix}db_schema.sql"/>
	  </databaseToDdl>
	

	</target>

Jens Ihrig 
Key-Work Consulting GmbH | Kriegsstr. 100 | 76133 Karlsruhe | Germany | www.key-work.de
Fon: +49-721-78203-15 | E-Mail: jens.ihrig@key-work.de | Fax: +49-721-78203-10

Key-Work Consulting GmbH Karlsruhe, HRB 108695, HRG Mannheim
Geschäftsführer: Andreas Stappert, Tobin Wotring

Anas Mughal wrote:
> What database were you using?

Oracle 10.

-- 
Best regards
Erik

Thomas Dudziak wrote:
> On Wed, Sep 24, 2008 at 1:00 AM, Erik Drolshammer
> <erik.drolshammer@gmail.com> wrote:
> 
>> I have successfully  made a dump from an existing database with
>> readModelFromDatabase. (So my setup seems to work.)
>>
>> How can I do the same for the data?
> 
> For API samples, see http://db.apache.org/ddlutils/api-usage.html, and
> also the javadoc for the DatabaseDataIO class
> (http://db.apache.org/ddlutils/api/org/apache/ddlutils/io/DatabaseDataIO.html).

1. The following gives no errors, but no data is written to data.xml.

DatabaseDataIO databaseDataIO = new DatabaseDataIO();
String xmlEncoding = "UTF-8";
databaseDataIO.writeDataToXML(oracle10Platform, oracleDatabase, 
"data.xml", xmlEncoding);


2.
DatabaseDataIO databaseDataIO = new DatabaseDataIO();
String xmlEncoding = "UTF-8";
databaseDataIO.writeDataToXML(oracle10Platform, "data.xml", xmlEncoding);

gives the following error:


org.apache.ddlutils.DatabaseOperationException: Error while performing a 
query
	at 
org.apache.ddlutils.platform.PlatformImplBase.query(PlatformImplBase.java:899)
	at 
org.apache.ddlutils.io.DatabaseDataIO.writeDataForTableToXML(DatabaseDataIO.java:538)
	at 
org.apache.ddlutils.io.DatabaseDataIO.writeDataToXML(DatabaseDataIO.java:381)
	at 
org.apache.ddlutils.io.DatabaseDataIO.writeDataToXML(DatabaseDataIO.java:359)
	at 
org.apache.ddlutils.io.DatabaseDataIO.writeDataToXML(DatabaseDataIO.java:279)

Caused by: java.sql.SQLException: ORA-00942: table or view does not 
exist  at 
oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)
	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:331)
	at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:288)
	at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:745)
	at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:207)
	at 
oracle.jdbc.driver.T4CStatement.executeForDescribe(T4CStatement.java:801)
	at 
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1039)
	at 
oracle.jdbc.driver.T4CStatement.executeMaybeDescribe(T4CStatement.java:841)
	at 
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1134)
	at 
oracle.jdbc.driver.OracleStatement.executeQuery(OracleStatement.java:1274)
	at 
org.apache.commons.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
	at 
org.apache.ddlutils.platform.PlatformImplBase.query(PlatformImplBase.java:893)
	... 34 more


I have checked with an external tool (SqlDeveloper) that some of the 
tables contain data. In tips?


-- 
Best regards
Erik Drolshammer

On Wed, Sep 24, 2008 at 1:00 AM, Erik Drolshammer
<erik.drolshammer@gmail.com> wrote:

> I have successfully  made a dump from an existing database with
> readModelFromDatabase. (So my setup seems to work.)
>
> How can I do the same for the data?

For API samples, see http://db.apache.org/ddlutils/api-usage.html, and
also the javadoc for the DatabaseDataIO class
(http://db.apache.org/ddlutils/api/org/apache/ddlutils/io/DatabaseDataIO.html).

For Ant, have a look at the writedatatofile command of the
databaseToDdl Ant task (http://db.apache.org/ddlutils/ant/).

Tom

What database were you using?
Thanks.

--
Anas Mughal
Bluenog



-----Original Message-----
From: Erik Drolshammer [mailto:erik.drolshammer@gmail.com] 
Sent: Wednesday, September 24, 2008 4:01 AM
To: ddlutils-user@db.apache.org
Subject: read data from database

Hi!
I have successfully  made a dump from an existing database with 
readModelFromDatabase. (So my setup seems to work.)

How can I do the same for the data?


-- 
Best regards
Erik Drolshammer

Hi!
I have successfully  made a dump from an existing database with 
readModelFromDatabase. (So my setup seems to work.)

How can I do the same for the data?


-- 
Best regards
Erik Drolshammer

Hi,

Waht we basically do is to call the databaseToDdl Ant task to generate 
the XML from the DB schema, and then there is another task called 
ddlToDatabase that reads the XML of a DB and is *supposedly* able to 
generate the schema, generating the appropariate DDL statements for the 
database. I say supposedly because we don't use the second task :).

You can find the information and some examples on using the tasks here:
http://db.apache.org/ddlutils/ant/

Maybe looking at the source code of both tasks, you can come up with a 
way to short-circuit what they do and do it in one pass.

Good luck!
D.


Erik Drolshammer escribió:
> Daniel López wrote:
>> With DDLUtils, you can also export the database schema to an XML 
>> database independent format, so I guess that if not direcly, you could 
>> at least export the schema from oracle to the XML format and then from 
>> the XML to Derby.
>> There probably is a way of doing the same process programatically, but 
>> I just use DDLUtils through the Ant tasks, so I don't have experience 
>> with that. But just so you know there is at least one way of doing it.
> 
> This is exactly what I'm looking for. Could you provide some more 
> details as to how it can be done?
> (The ant task approach might or might not be the approach I choose to 
> use, but at least it gives me the parameters and perhaps pointers to 
> which code that support this.)
> 


-- 
-------------------------------------------
Daniel Lopez Janariz (D.Lopez@uib.es)
Web Services
Centre for Information and Technology
Balearic Islands University
(SPAIN)
-------------------------------------------

Daniel López wrote:
> With DDLUtils, you can also export the database schema to an XML 
> database independent format, so I guess that if not direcly, you could 
> at least export the schema from oracle to the XML format and then from 
> the XML to Derby.
> There probably is a way of doing the same process programatically, but I 
> just use DDLUtils through the Ant tasks, so I don't have experience with 
> that. But just so you know there is at least one way of doing it.

This is exactly what I'm looking for. Could you provide some more 
details as to how it can be done?
(The ant task approach might or might not be the approach I choose to 
use, but at least it gives me the parameters and perhaps pointers to 
which code that support this.)

-- 
Best regards
Erik Drolshammer

Hi,

With DDLUtils, you can also export the database schema to an XML 
database independent format, so I guess that if not direcly, you could 
at least export the schema from oracle to the XML format and then from 
the XML to Derby.
There probably is a way of doing the same process programatically, but I 
just use DDLUtils through the Ant tasks, so I don't have experience with 
that. But just so you know there is at least one way of doing it.

S!
D.


Erik Drolshammer escribió:
> Hi!
> I want to use Derby as an in-mem substitute for Oracle for automatic 
> testing purposes.
> 
> I have successfully exported the schema from an existing Oracle schema 
> (without data) to a ddl-file, but when I try to create tables etc. in 
> Derby I run into problems.
> 
> Does DdlUtils support some sort of automatic conversion between 
> "Oracle-sql" and "Derby-sql"?
> Or must I manually convert e.g. Oracle's "varchar2" to Derby's "varchar?
> 
> 
> This is the setup I currently use:
> 
> //Create ddl from Oracle database
> Oracle10Platform oracle10Platform = new Oracle10Platform();
> oracle10Platform.setDataSource(dataSource);
> Database database = oracle10Platform.readModelFromDatabase(name, 
> catalog, schema, tableTypes);
> 
> 
> //Create Derby tables from Oracle ddl source
> oracle10Platform.createTables(conn, database, 
> dropTablesFirst,continueOnError);

Hi!
I want to use Derby as an in-mem substitute for Oracle for automatic 
testing purposes.

I have successfully exported the schema from an existing Oracle schema 
(without data) to a ddl-file, but when I try to create tables etc. in 
Derby I run into problems.

Does DdlUtils support some sort of automatic conversion between 
"Oracle-sql" and "Derby-sql"?
Or must I manually convert e.g. Oracle's "varchar2" to Derby's "varchar?


This is the setup I currently use:

//Create ddl from Oracle database
Oracle10Platform oracle10Platform = new Oracle10Platform();
oracle10Platform.setDataSource(dataSource);
Database database = oracle10Platform.readModelFromDatabase(name, 
catalog, schema, tableTypes);


//Create Derby tables from Oracle ddl source
oracle10Platform.createTables(conn, database, 
dropTablesFirst,continueOnError);


-- 
Best regards
Erik Drolshammer

On Mon, Jun 9, 2008 at 4:24 AM, Rijk van Haaften
<r.j.c.vanhaaften@gmail.com> wrote:

> Is there a (good?) reason for this:
> Table.findColumn(String)
> Table.findIndex(String)
> but
> Table.findForeignKey(ForeignKey)

The reason is that foreign keys are not required to have a name.
However, you're right, there is no reason to not provide a
findForeignKey method that takes a name for easier access to foreign
keys that have a name (feel free to create a JIRA issue for this).

Tom

Dear all,

Is there a (good?) reason for this:
Table.findColumn(String)
Table.findIndex(String)
but
Table.findForeignKey(ForeignKey)
?

-- 
Rijk J.C. van Haaften

Klaas Kloosterweg West 9a
7954 PR Rouveen
0522-291159
06-49416002

Hi all,

When I apply a table change on a table that uses auto-increment (I use
postgresql which implements auto-incr. with sequences) the sequences
are reset. I suspect a RecreateTableChange that recreates the table
using a temporary table to migrate the data but doesn't migrate the
sequence. Is this a bug, or should I use the api in a different way?

-- 
Rijk J.C. van Haaften

Klaas Kloosterweg West 9a
7954 PR Rouveen
0522-291159
06-49416002

On Sat, May 24, 2008 at 4:55 PM, Hacking Bear <hackingbear@gmail.com> wrote:

> I'm new to dbUtils and i cannot find answers to my question. Please help me.
>
> I want to export my schema to SQL DDL from SQL Server but the output sql
> file is empty (even though the XML schema file has valid data.) Apparently,
> my task, connection, etc. works. Only the generated SQL file is empty. any
> idea?

That is odd. Could you try running the writeSchemaSqlToFile subtask
within the ddlToDatabase task using the ss-schema.xml file that you
got ? That will basically perform the same operation except that it
does not use a live database but the database model contained in the
ss-schema.xml file.

Tom

Hi,

I'm new to dbUtils and i cannot find answers to my question. Please help me.

I want to export my schema to SQL DDL from SQL Server but the output sql
file is empty (even though the XML schema file has valid data.) Apparently,
my task, connection, etc. works. Only the generated SQL file is empty. any
idea?

Thanks!


My Ant task is

    <target name="db-dump" description="Dumps the database structure">
      <taskdef name="databaseToDdl"
               classname="org.apache.ddlutils.task.DatabaseToDdlTask">
        <classpath refid="runtime-classpath"/>
      </taskdef>
      <databaseToDdl modelName="ss" schemapattern="dbo" verbosity="debug"
        databaseType="mssql">
        <database url="jdbc:sqlserver://localhost:1433;DatabaseName=avop"

driverClassName="com.microsoft.sqlserver.jdbc.SQLServerDriver"
                  username="sa"
                  password="sa"/>
        <writeSchemaToFile outputFile="ss-schema.xml"/>
        <writeSchemaSqlToFile outputFile="ss.sql"/>
      </databaseToDdl>
    </target>

running from cygwin bash:

$ ant -lib dist -lib lib ; ls -l *.xml *.sql
Buildfile: build.xml

db-dump:
[databaseToDdl] May 24, 2008 4:50:56 PM
com.microsoft.sqlserver.jdbc.AuthenticationJNI <clinit>
[databaseToDdl] WARNING: Failed to load the sqljdbc_auth.dll
[databaseToDdl] Borrowed connection
org.apache.commons.dbcp.PoolableConnection@54a328 from data source
[databaseToDdl] Returning connection
org.apache.commons.dbcp.PoolableConnection@54a328 to data source.
[databaseToDdl] Remaining connections: None
[databaseToDdl] Written schema to d:\dbutils\ss-schema.xml
[databaseToDdl] Borrowed connection
org.apache.commons.dbcp.PoolableConnection@54a328 from data source
[databaseToDdl] Returning connection
org.apache.commons.dbcp.PoolableConnection@54a328 to data source.
[databaseToDdl] Remaining connections: None
[databaseToDdl] Written schema SQL to d:\dbutils\ss.sql

BUILD SUCCESSFUL
Total time: 7 seconds
---------- 1 me    mkpasswd 49959 May 24 16:51 ss-schema.xml
---------- 1 me    mkpasswd     0 May 24 16:51 ss.sql