Mailing-List: contact users-help@apex.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@apex.apache.org
Date: Tue, 28 Jun 2016 22:46:25 +0000 (UTC)
From: Jaikit Jilka <jjilka@leadferret.com>
To: users <users@apex.apache.org>
Message-ID: <447995649.492664.1467153985906.JavaMail.zimbra@leadferret.com>
In-Reply-To: <CAAR+c0kFXy7pOH7KVBRd-h6JgN4fYVZB6P5AzH7OnZ30Xt245Q@mail.gmail.com>
References: <1779869127.434487.1466702239430.JavaMail.zimbra@leadferret.com> <CAJ484BiY4HFJk9Y89VqnoP2aKCUpPGYAqcdiFR_=43fmRok0DQ@mail.gmail.com> <465301908.451318.1466791196236.JavaMail.zimbra@leadferret.com> <CAAR+c0mqQrHfmW1FHvKtOHRoq=LK4EZMUwpufgZvJpvioQSbiA@mail.gmail.com> <259070009.452826.1466793091374.JavaMail.zimbra@leadferret.com> <CAAR+c0=urxstiYZ7eqXrDdJPvDxxYxdcoUicmMG5WmdNh=hwNg@mail.gmail.com> <154219658.454257.1466802784579.JavaMail.zimbra@leadferret.com> <CAAR+c0kFXy7pOH7KVBRd-h6JgN4fYVZB6P5AzH7OnZ30Xt245Q@mail.gmail.com>
Subject: Re: Jdbcoutputoperator implementation
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Thread-Topic: Jdbcoutputoperator implementation
Thread-Index: RcDp0sfsxiEwNmYhFXSze777mllehA==
archived-at: Tue, 28 Jun 2016 22:48:18 -0000

Hello,

I am getting an error as follow:

Stopped running due to an exception. java.lang.ClassCastException: java.lan=
g.String cannot be cast to com.mycompany.test.PojoEvent
=09at SC.get(Unknown Source)
=09at com.datatorrent.lib.db.jdbc.JdbcPOJOOutputOperator.setStatementParame=
ters(JdbcPOJOOutputOperator.java:175)
=09at com.datatorrent.lib.db.jdbc.AbstractJdbcTransactionableOutputOperator=
.processBatch(AbstractJdbcTransactionableOutputOperator.java:114)
=09at com.datatorrent.lib.db.jdbc.AbstractJdbcTransactionableOutputOperator=
.endWindow(AbstractJdbcTransactionableOutputOperator.java:93)
=09at com.datatorrent.stram.engine.GenericNode.processEndWindow(GenericNode=
.java:145)
=09at com.datatorrent.stram.engine.GenericNode.run(GenericNode.java:351)
=09at com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContai=
ner.java:1388)

I am not sure where to check the cast mismatch. I am inserting a value in t=
he database.

Thank You,

Jaikit Jilka

----- Original Message -----
From: "Pradeep A. Dalvi" <prad@apache.org>
To: "users" <users@apex.apache.org>
Sent: Friday, June 24, 2016 4:45:18 PM
Subject: Re: Jdbcoutputoperator implementation

What are errors/exceptions seen in JdbcOutput container logs?
Are you setting Context.PortContext.TUPLE_CLASS to POJO class being used?

--
prad

On Fri, Jun 24, 2016 at 2:13 PM, Jaikit Jilka <jjilka@leadferret.com> wrote=
:
> Hello,
>
> I resolved that error and now I can launch the application, But now the c=
ontainer which has jdbcoperator is getting killed. I am attaching the dt.lo=
g file of container which is running but does not have any operator.
>
> Thank You,
>
> Jaikit Jilka
>
> ----- Original Message -----
> From: "Pradeep A. Dalvi" <prad@apache.org>
> To: "users" <users@apex.apache.org>
> Sent: Friday, June 24, 2016 11:41:47 AM
> Subject: Re: Jdbcoutputoperator implementation
>
> Yes, because it is not yet released. Compile & install latest malhar
> in local ~/.m2 directory.
> For that, git clone Malhar library repository. And do 'mvn clean
> install' in that malhar clone.
>
> On Fri, Jun 24, 2016 at 11:31 AM, Jaikit Jilka <jjilka@leadferret.com> wr=
ote:
>> Hello,
>>
>> When I change my malher version in POM.xml to the latest i.e 3.5.0-SNAPS=
HOT it gives me an build time error : Failure to find org.apache.apex:malha=
r-library:jar:3.5.0-SNAPSHOT in https://www.datatorrent.com/maven/content/r=
epositories/snapshots/.
>>
>> Thank You,
>>
>> Jaikit Jilka
>>
>> ----- Original Message -----
>> From: "Pradeep A. Dalvi" <prad@apache.org>
>> To: "users" <users@apex.apache.org>
>> Sent: Friday, June 24, 2016 11:13:42 AM
>> Subject: Re: Jdbcoutputoperator implementation
>>
>> This issue was in 3.4 malhar and fixed later on. Fix is present in
>> master branch. You can use latest malhar.
>> For reference: https://github.com/apache/apex-malhar/blob/master/library=
/src/main/java/com/datatorrent/lib/db/jdbc/AbstractJdbcTransactionableOutpu=
tOperator.java#L142
>>
>> On Fri, Jun 24, 2016 at 10:59 AM, Jaikit Jilka <jjilka@leadferret.com> w=
rote:
>>> Hello,
>>>
>>> I am setting UpdateCommand to empty string from properties.xml file sti=
ll I am getting the same error
>>>
>>> <property>
>>>         <name>dt.application.MyWordCountApplication.operator.JdbcOutput=
.prop.setupdateCommand</name>
>>>         <value> </value>
>>>     </property>
>>>
>>> error:
>>>
>>> An error occurred trying to launch the application. Server message: jav=
ax.validation.ConstraintViolationException: Operator JdbcOutput violates co=
nstraints [ConstraintViolationImpl{rootBean=3DJdbcPOJOOutputOperator{name=
=3Dnull}, propertyPath=3D'updateCommand', message=3D'may not be null', leaf=
Bean=3DJdbcPOJOOutputOperator{name=3Dnull}, value=3Dnull}] at com.datatorre=
nt.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1680) at com.da=
tatorrent.stram.StramClient.<init>(StramClient.java:161) at com.datatorrent=
.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:509) at com.=
datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2050) at com.d=
atatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3456) at com.datator=
rent.stram.cli.DTCli.access$7100(DTCli.java:106) at com.datatorrent.stram.c=
li.DTCli$LaunchCommand.execute(DTCli.java:1895) at com.datatorrent.stram.cl=
i.DTCli$3.run(DTCli.java:1449)
>>>
>>> Thank You,
>>>
>>> Jaikit Jilka
>>>
>>> ----- Original Message -----
>>> From: "Munagala Ramanath" <ram@datatorrent.com>
>>> To: "users" <users@apex.apache.org>
>>> Sent: Thursday, June 23, 2016 3:32:42 PM
>>> Subject: Re: Jdbcoutputoperator implementation
>>>
>>> Please look at:
>>>
>>> http://docs.datatorrent.com/beginner/ and
>>> http://docs.datatorrent.com/application_packages/
>>>
>>> for examples on how to set properties from XML files.
>>>
>>> Ram
>>>
>>> On Thu, Jun 23, 2016 at 3:25 PM, Jaikit Jilka <jjilka@leadferret.com> w=
rote:
>>>
>>>> Hello,
>>>>
>>>> How to pass an empty string for updatecommand in properties.xml.
>>>> When I change my malhar version to 3.5.0-SNAPSHOT it gives me a compli=
e
>>>> time error -Failure to find
>>>> org.apache.apex:malhar-library:jar:3.5.0-SNAPSHOT in
>>>> https://www.datatorrent.com/maven/content/repositories/snapshots/
>>>>
>>>> Thank You,
>>>>
>>>> Jaikit Jilka
>>>>
>>>> ----- Original Message -----
>>>> From: "Pradeep A. Dalvi" <prad@apache.org>
>>>> To: "users" <users@apex.apache.org>
>>>> Sent: Thursday, June 23, 2016 12:43:40 PM
>>>> Subject: Re: Jdbcoutputoperator implementation
>>>>
>>>> Hi Jaikit,
>>>>
>>>> This constraint violation exception was enforced from
>>>> AbstractJdbcTransactionableOutputOperator. In 3.3/3.4 malhar library,
>>>> updateCommand parameter has constraint set to @NotNull on getter
>>>> method.
>>>>
>>>> You could do either of following to solve this:
>>>> 1. Set updateCommand from properties.xml to empty string
>>>> 2. Use master branch of Malhar
>>>> 3. Remove @NotNull on getUpdateCommand in
>>>> AbstractJdbcTransactionableOutputOperator
>>>>
>>>> Cheers,
>>>> Pradeep A. Dalvi
>>>>
>>>> On Thu, Jun 23, 2016 at 11:36 AM, Jaikit Jilka <jjilka@leadferret.com>
>>>> wrote:
>>>> > Hi Devendra,
>>>> >
>>>> > I tried to run your application. I followed all steps mentioned but =
I am
>>>> getting following error.
>>>> >
>>>> > An error occurred trying to launch the application. Server message:
>>>> javax.validation.ConstraintViolationException: Operator JdbcOutput vio=
lates
>>>> constraints
>>>> [ConstraintViolationImpl{rootBean=3DJdbcPOJOOutputOperator{name=3Dnull=
},
>>>> propertyPath=3D'updateCommand', message=3D'may not be null',
>>>> leafBean=3DJdbcPOJOOutputOperator{name=3Dnull}, value=3Dnull}] at
>>>> com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.ja=
va:1680)
>>>> at com.datatorrent.stram.StramClient.<init>(StramClient.java:161) at
>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLaunch=
er.java:509)
>>>> at com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:20=
50)
>>>> at com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3456) a=
t
>>>> com.datatorrent.stram.cli.DTCli.access$7100(DTCli.java:106) at
>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1895)=
 at
>>>> com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1449)
>>>> >
>>>> > Thank you,
>>>> >
>>>> > Jaikit Jilka
>>>> >
>>>> > ----- Original Message -----
>>>> > From: "Devendra Tagare" <devendrat@datatorrent.com>
>>>> > To: "users" <users@apex.apache.org>
>>>> > Sent: Thursday, June 23, 2016 10:32:17 AM
>>>> > Subject: Re: Jdbcoutputoperator implementation
>>>> >
>>>> > Hi Jalkit,
>>>> >
>>>> > The JdbcPOJOOutputOperator is being configured with the
>>>> > JdbcTransactionalStore which requires an additional dt_meta table.
>>>> >
>>>> > The table schema is here -
>>>> >
>>>> https://github.com/devtagare/examples/blob/SPOI-8251/tutorials/jdbcToJ=
dbc/src/test/resources/example.sql
>>>> >
>>>> > You can find an example application which uses the JdbcPOJOOutputOpe=
rator
>>>> > here -
>>>> >
>>>> https://github.com/devtagare/examples/tree/SPOI-8251/tutorials/jdbcToJ=
dbc
>>>> >
>>>> > Thanks,
>>>> > Dev
>>>> >
>>>> > On Thu, Jun 23, 2016 at 10:17 AM, Jaikit Jilka <jjilka@leadferret.co=
m>
>>>> > wrote:
>>>> >
>>>> >> Hello,
>>>> >>
>>>> >> I am currently working on an application which simply read data fro=
m
>>>> .txt
>>>> >> file and slpits the words and inserts them into mysql. But I am get=
ting
>>>> >> error. I am using jdbcpojooutputoperator from malhar library. But I=
 am
>>>> >> getting an error on ActiveFieldInfos which says it is protected in
>>>> >> jdbcpojoinputoperator and also I do not know what to do in
>>>> Application.java
>>>> >> file. I am attaching both the file here. Kindly help me resolve the
>>>> issue.
>>>> >>
>>>> >> Thank You,
>>>> >>
>>>> >> Jaikit Jilka
>>>>