Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@ignite.apache.org
MIME-Version: 1.0
References: <CAKr8LfwE41WUWxsv3Cz4=OvQ1vSNzwzrkt+UvgDq8osuVQnTLA@mail.gmail.com>
 <0A95B42E-0CF6-4484-9F08-D3A2DB850244@apache.org> <CAKr8LfyJi9rBvmCK1tsd1UAcpX=gXe3F+ROkUAL0zXVeecdc-g@mail.gmail.com>
 <04ED1DB4-9BC7-463B-BFBD-C801EAFF42BD@apache.org> <CAKr8Lfyme_HsvJcE6dryu7SrfLEX03qujwZMe7bwgf-knYZZ3Q@mail.gmail.com>
 <CAKr8Lfz_yK-A_U9cSvew8bFdxJvEMhVXvGJXV3wNrdss7ZCpRg@mail.gmail.com>
 <35FDB988-6E02-4342-BC9C-5D27A90E3D9F@apache.org> <CAKr8Lfw_1YHHO6evR3=fRC9OM0-Hmiqg2kAGWgur-jN2c28X4A@mail.gmail.com>
 <CAKr8LfxaO-W8CEKCxZDCMkMLGFYdVqpoTox+Wsfg6vYhDd8_tw@mail.gmail.com>
 <6379CAB6-48F3-43CD-8E81-E0EE6B53AA46@apache.org> <CADez4_W6zS8c1QPRNYeOQOqskbh2R=Z7kAPYqYBwfW-eVXfwOQ@mail.gmail.com>
 <CAKr8Lfxvpba6MFqej414zQcZq1V+b5uNiLuWGNGdTTovaDcr3w@mail.gmail.com>
 <CAKr8LfzYg8SH0EAp+2nORyo7q_q4fYsauch+Vivpj=y2O_VYnA@mail.gmail.com> <4E97EC29-E566-4654-955D-F78BF6E2446F@apache.org>
In-Reply-To: <4E97EC29-E566-4654-955D-F78BF6E2446F@apache.org>
From: ALEKSEY KUZNETSOV <alkuznetsov.sb@gmail.com>
Date: Mon, 17 Apr 2017 07:44:23 +0000
Message-ID: <CAKr8LfxE7qJGXC85mtzo-jCi77GA5xBqYhHj2CNejCuMy1s5jw@mail.gmail.com>
Subject: Re: TouchedExpiryPolicy works incorrect in some cases IGNITE-4401
To: dev@ignite.apache.org
Content-Type: multipart/alternative; boundary=001a11c0105855b38b054d57f6c8
archived-at: Mon, 17 Apr 2017 07:44:48 -0000

--001a11c0105855b38b054d57f6c8
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Why do u think so.
First of all, the output above is not correct. After 3 iteration key-value
API strats to return empty value.

Every 5 seconds(iteration sleep time) repository.getAttributes("1").size()
is got called. Which makes an entry "touch" and the entry wont be expired
for as long as 10 seconds.

Expiry policy says:

An {@link ExpiryPolicy} that defines the expiry {@link Duration}
* of a Cache Entry based on when it was last touched. A touch includes
** creation, update or **access**.*


=D0=BF=D1=82, 14 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 18:42, Denis Magda=
 <dmagda@apache.org>:

> The iteration happens multiple time which means that the key-value API ha=
d
> to return an empty result set on second or third iteration. But this neve=
r
> happens.
>
> In any case, do you want to find a root of the issue and fix it?
> Otherwise, we can update the description and wait while someone else fixe=
s
> it.
>
> =E2=80=94
> Denis
>
> > On Apr 14, 2017, at 1:33 AM, ALEKSEY KUZNETSOV <alkuznetsov.sb@gmail.co=
m>
> wrote:
> >
> > Because expiry time is 10 seconds, while loop iterates every 5 seconds
> >
> > =D0=BF=D1=82, 14 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 11:32, ALEKSEY=
 KUZNETSOV <alkuznetsov.sb@gmail.com
> >:
> >
> >> No, the bug is in SQL query, not key-value storage.
> >>
> >> =D0=BF=D1=82, 14 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 11:11, Vladis=
lav Pyatkov <vldpyatkov@gmail.com>:
> >>
> >>> Denis, Aleksey,
> >>>
> >>> It is correct, remember I have already said something like[1].
> >>> I have no idea, why this happened in this case with SQL.
> >>>
> >>> [1]:
> >>>
> >>>
> http://apache-ignite-developers.2346864.n4.nabble.com/TouchedExpiryPolicy=
-works-incorrect-in-some-cases-IGNITE-4401-td16349.html#a16356
> >>>
> >>> On Fri, Apr 14, 2017 at 4:29 AM, Denis Magda <dmagda@apache.org>
> wrote:
> >>>
> >>>> I could reproduce the issue and this should be what Denis K. meant b=
y
> >>>> saying =E2=80=9Cexpiration policy works incorrectly=E2=80=9D.
> >>>>
> >>>> If you remove the expiration policy from the caches' configuration
> then
> >>>> the issue disappears. In general, SQL engine processes an expiration
> >>> event
> >>>> properly because the SQL queries return an empty result set as
> expected
> >>> but
> >>>> something doesn=E2=80=99t work well with key-value operations.
> >>>>
> >>>> *Denis K*, *Vlad P.*, as creators of the ticket please confirm that
> this
> >>>> is the case.
> >>>>
> >>>> Please keep debugging this and switch to the latest Ignite version.
> >>>>
> >>>> =E2=80=94
> >>>> Denis
> >>>>
> >>>>
> >>>>> On Apr 13, 2017, at 4:22 AM, ALEKSEY KUZNETSOV <
> >>> alkuznetsov.sb@gmail.com>
> >>>> wrote:
> >>>>>
> >>>>> any feedback?
> >>>>>
> >>>>> =D1=87=D1=82, 13 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 11:51, ALE=
KSEY KUZNETSOV <
> >>> alkuznetsov.sb@gmail.com
> >>>>> :
> >>>>>
> >>>>>> You should run ExpiryPolicyTest. The output should contain strings
> >>> like
> >>>>>> contains? new AffinityKey("1", "1"): and contains?2 new
> >>>> AffinityKey("1", "
> >>>>>> 1"): and empty cursor? =3D
> >>>>>> If you look at them you will see, that cache contains affinity key
> >>> new
> >>>>>> AffinityKey("1", "1") whereas cursor is empty(on second iteration)=
.
> >>> From
> >>>>>> this output you can conclude SQL query returns icorrect data(empty
> >>>> value)
> >>>>>>
> >>>>>>
> >>>>>> =D1=87=D1=82, 13 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 3:42, Den=
is Magda <dmagda@apache.org>:
> >>>>>>
> >>>>>>> Bluntly speaking I have no idea where to look and what to expect.
> >>> This
> >>>> is
> >>>>>>> output of the test execution of my machine:
> >>>>>>>
> >>>>>>> SQL res: [[1], [d]]
> >>>>>>> 2
> >>>>>>> Op consume: 303
> >>>>>>> Value: org.ignite.test.EDU@22db8f4
> >>>>>>> SQL res: []
> >>>>>>> 0
> >>>>>>> Op consume: 9
> >>>>>>> Value: org.ignite.test.EDU@29caf222
> >>>>>>> SQL res: []
> >>>>>>> 0
> >>>>>>> Op consume: 15
> >>>>>>> Value: org.ignite.test.EDU@7cd1ac19
> >>>>>>> SQL res: []
> >>>>>>> 0
> >>>>>>> Op consume: 5
> >>>>>>>
> >>>>>>> Please be more specific, there are too many files in the code.
> >>>>>>>
> >>>>>>> =E2=80=94
> >>>>>>> Denis
> >>>>>>>
> >>>>>>>> On Apr 12, 2017, at 4:50 AM, ALEKSEY KUZNETSOV <
> >>>>>>> alkuznetsov.sb@gmail.com> wrote:
> >>>>>>>>
> >>>>>>>> So what do u think about the issue ?
> >>>>>>>>
> >>>>>>>> =D1=81=D1=80, 12 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 10:42, =
ALEKSEY KUZNETSOV <
> >>>>>>> alkuznetsov.sb@gmail.com>:
> >>>>>>>>
> >>>>>>>>> I have already attached simlified version. Shall i simplify it
> >>> more ?
> >>>>>>>>>
> >>>>>>>>> =D0=B2=D1=82, 11 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 19:28,=
 Denis Magda <dmagda@apache.org>:
> >>>>>>>>>
> >>>>>>>>> Can you attach the simplified version? Just want to avoid any
> side
> >>>>>>> effects.
> >>>>>>>>>
> >>>>>>>>> =E2=80=94
> >>>>>>>>> Denis
> >>>>>>>>>
> >>>>>>>>>> On Apr 11, 2017, at 9:14 AM, ALEKSEY KUZNETSOV <
> >>>>>>> alkuznetsov.sb@gmail.com>
> >>>>>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>> I took it from
> https://issues.apache.org/jira/browse/IGNITE-4401
> >>> <
> >>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4401> and
> >>> simplified .
> >>>>>>> See
> >>>>>>>>> in attached
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> =D0=B2=D1=82, 11 =D0=B0=D0=BF=D1=80. 2017 =D0=B3. =D0=B2 19:03=
, Denis Magda <dmagda@apache.org
> >>>> <mailto:
> >>>>>>>>> dmagda@apache.org>>:
> >>>>>>>>>> Hello,
> >>>>>>>>>>
> >>>>>>>>>> Do you have sample code?
> >>>>>>>>>>
> >>>>>>>>>> =E2=80=94
> >>>>>>>>>> Denis
> >>>>>>>>>>> On Apr 11, 2017, at 2:45 AM, ALEKSEY KUZNETSOV <
> >>>>>>>>> alkuznetsov.sb@gmail.com <mailto:alkuznetsov.sb@gmail.com>>
> >>> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>> Hi, igniters!
> >>>>>>>>>>> While doing https://issues.apache.org/jira/browse/IGNITE-4401
> <
> >>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4401> ticket i cam=
e
> >>>>>>>>>>> across the fact that cache querying returns null , while cach=
e
> >>>> still
> >>>>>>>>> has
> >>>>>>>>>>> got entry.
> >>>>>>>>>>> Cache query : SELECT nameProp FROM EDUProp WHERE EDUId =3D 1
> >>>>>>>>>>> Cache get operation : ignite().cache("eduPropCache").get(new
> >>>>>>>>> AffinityKey("1",
> >>>>>>>>>>> "1")) non-null
> >>>>>>>>>>> I cannot even imagine what could be wrong with it.
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> --
> >>>>>>>>>>>
> >>>>>>>>>>> *Best Regards,*
> >>>>>>>>>>>
> >>>>>>>>>>> *Kuznetsov Aleksey*
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> Best Regards,
> >>>>>>>>>>
> >>>>>>>>>> Kuznetsov Aleksey
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>> *Best Regards,*
> >>>>>>>>>
> >>>>>>>>> *Kuznetsov Aleksey*
> >>>>>>>>>
> >>>>>>>> --
> >>>>>>>>
> >>>>>>>> *Best Regards,*
> >>>>>>>>
> >>>>>>>> *Kuznetsov Aleksey*
> >>>>>>>
> >>>>>>> --
> >>>>>>
> >>>>>> *Best Regards,*
> >>>>>>
> >>>>>> *Kuznetsov Aleksey*
> >>>>>>
> >>>>> --
> >>>>>
> >>>>> *Best Regards,*
> >>>>>
> >>>>> *Kuznetsov Aleksey*
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> Vladislav Pyatkov
> >>>
> >> --
> >>
> >> *Best Regards,*
> >>
> >> *Kuznetsov Aleksey*
> >>
> > --
> >
> > *Best Regards,*
> >
> > *Kuznetsov Aleksey*
>
> --

*Best Regards,*

*Kuznetsov Aleksey*

--001a11c0105855b38b054d57f6c8--