geode-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nabarun Nag <n...@apache.org>
Subject Re: Odg: gateway sender queue
Date Thu, 14 Nov 2019 19:28:38 GMT
+1 to Dan's suggestion

What about a log and a vsd stat in the gfs file which tells us if any
cleanQueue commands were executed.


Regards
Nabarun Nag

On Thu, Nov 14, 2019 at 10:27 AM Udo Kohlmeyer <udo@apache.com> wrote:

> In addition... making is default has bigger consequences that we have
> not thought about..
>
> e.g if you purge an existing queue on start up.. is this the start up of
> the server node / GS Queue? Given that we have shared-nothing
> architecture, purging *should* only be local and not cluster-wide... I'd
> be interested and see a proposal on this feature.
>
> --Udo
>
> On 11/14/19 10:24 AM, Jason Huynh wrote:
> > +1 to Dan's suggestion
> >
> > On Thu, Nov 14, 2019 at 9:52 AM Dan Smith <dsmith@pivotal.io> wrote:
> >
> >> I'm ok with adding a --cleanQueue option.
> >>
> >> However, I don't think it should default to be true, since that would be
> >> changing the behavior of the existing command. It should default to
> false.
> >>
> >> -Dan
> >>
> >> On Thu, Nov 14, 2019 at 9:28 AM Xiaojian Zhou <gzhou@pivotal.io> wrote:
> >>
> >>> The --cleanQueue option is a similar idea as Barry's "DeadLetter"
> spike.
> >> I
> >>> remembered that we decided not to do it.
> >>>
> >>>
> >>> On Wed, Nov 13, 2019 at 11:41 PM Mario Ivanac <mario.ivanac@est.tech>
> >>> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> just to remind you on last question:
> >>>>
> >>>> what is your opinion on adding additional option in gfsh command
> >> "start
> >>>> gateway sender"
> >>>> to control clearing of existing queues --cleanQueues.
> >>>>
> >>>> This option will indicate, when gateway sender is started, should we
> >>>> discard/clean existing queue, or should we use existing queue.
> >>>> By default it will be to discard/clean existing queue.
> >>>>
> >>>> Best Regards,
> >>>> Mario
> >>>> ________________________________
> >>>> Šalje: Mario Ivanac <mario.ivanac@est.tech>
> >>>> Poslano: 8. studenog 2019. 13:00
> >>>> Prima: dev@geode.apache.org <dev@geode.apache.org>
> >>>> Predmet: Odg: gateway sender queue
> >>>>
> >>>> Hi all,
> >>>>
> >>>> one more clarification regarding 3rd question:
> >>>>
> >>>> "*   Could we add extra option in gfsh command  "start gateway sender"
> >>>>       that allows to control queues reset (for instance
> --cleanQueues)"
> >>>>
> >>>> This option will indicate, when gateway sender is started, should we
> >>>> discard/clean existing queue, or should we use existing queue.
> >>>> By default it will be to discard/clean existing queue.
> >>>>
> >>>> Best Regards,
> >>>> Mario
> >>>> ________________________________
> >>>> Šalje: Mario Ivanac <mario.ivanac@est.tech>
> >>>> Poslano: 7. studenog 2019. 9:01
> >>>> Prima: Dan Smith <dsmith@pivotal.io>; dev@geode.apache.org <
> >>>> dev@geode.apache.org>
> >>>> Predmet: Odg: gateway sender queue
> >>>>
> >>>> Hi,
> >>>>
> >>>> thanks for answers.
> >>>>
> >>>> Some more details regarding 1st question.
> >>>>
> >>>> Is this behavior same (for serial and parallel gateway sender) in case
> >>>> queue is persistent?
> >>>> Meaning, should queue (persistent) be purged if we restart gateway
> >>> sender?
> >>>>
> >>>> Thanks,
> >>>> Mario
> >>>>
> >>>> ________________________________
> >>>> Šalje: Dan Smith <dsmith@pivotal.io>
> >>>> Poslano: 5. studenog 2019. 18:52
> >>>> Prima: dev@geode.apache.org <dev@geode.apache.org>
> >>>> Predmet: Re: gateway sender queue
> >>>>
> >>>> Some replies, inline:
> >>>>
> >>>>    *   During testing we have observed, different behavior in parallel
> >> and
> >>>>> serial gateway senders. In case we manually stop, than start gateway
> >>>>> senders, for parallel gateway senders, queue is purged, but for
> >> serial
> >>>>> gateway senders this is not the case. Is this normal behavior or
bug?
> >>>>>
> >>>> Hmm, I also think stop is supposed to clear the queue. I think if you
> >> are
> >>>> seeing that it doesn't clear the queue, that might be a bug.
> >>>>
> >>>>
> >>>>
> >>>>>    *   What happens with the queues when whole cluster is stopped
and
> >>>> later
> >>>>> started (In our tests with persistent queues, the events are kept)?
> >>>>>
> >>>> Persistent queues will keep all of the events when you restart.
> >>>>
> >>>>
> >>>>>    *   Could we add extra option in gfsh command  "start gateway
> >> sender"
> >>>>> that allows to control queues reset (for instance --cleanQueues)?
> >>>>>
> >>>> If stop does clear the queue, would this be needed? It might still be
> >>>> reasonable - I've heard folks request a way to clear running queues
as
> >>>> well.
> >>>>
> >>>> -Dan
> >>>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message