geode-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Oleske <mole...@pivotal.io>
Subject Re: Odg: gateway sender queue
Date Fri, 15 Nov 2019 00:48:02 GMT
>
> vsd stat in the gfs file
>

Just here to say consider using a meter instead of stat as documented in
https://cwiki.apache.org/confluence/display/GEODE/How+to+add+a+Meter if
more than a log message is warrented.

-michael

On Thu, Nov 14, 2019 at 11:29 AM Nabarun Nag <nnag@apache.org> wrote:

> +1 to Dan's suggestion
>
> What about a log and a vsd stat in the gfs file which tells us if any
> cleanQueue commands were executed.
>
>
> Regards
> Nabarun Nag
>
> On Thu, Nov 14, 2019 at 10:27 AM Udo Kohlmeyer <udo@apache.com> wrote:
>
> > In addition... making is default has bigger consequences that we have
> > not thought about..
> >
> > e.g if you purge an existing queue on start up.. is this the start up of
> > the server node / GS Queue? Given that we have shared-nothing
> > architecture, purging *should* only be local and not cluster-wide... I'd
> > be interested and see a proposal on this feature.
> >
> > --Udo
> >
> > On 11/14/19 10:24 AM, Jason Huynh wrote:
> > > +1 to Dan's suggestion
> > >
> > > On Thu, Nov 14, 2019 at 9:52 AM Dan Smith <dsmith@pivotal.io> wrote:
> > >
> > >> I'm ok with adding a --cleanQueue option.
> > >>
> > >> However, I don't think it should default to be true, since that would
> be
> > >> changing the behavior of the existing command. It should default to
> > false.
> > >>
> > >> -Dan
> > >>
> > >> On Thu, Nov 14, 2019 at 9:28 AM Xiaojian Zhou <gzhou@pivotal.io>
> wrote:
> > >>
> > >>> The --cleanQueue option is a similar idea as Barry's "DeadLetter"
> > spike.
> > >> I
> > >>> remembered that we decided not to do it.
> > >>>
> > >>>
> > >>> On Wed, Nov 13, 2019 at 11:41 PM Mario Ivanac <mario.ivanac@est.tech
> >
> > >>> wrote:
> > >>>
> > >>>> Hi,
> > >>>>
> > >>>> just to remind you on last question:
> > >>>>
> > >>>> what is your opinion on adding additional option in gfsh command
> > >> "start
> > >>>> gateway sender"
> > >>>> to control clearing of existing queues --cleanQueues.
> > >>>>
> > >>>> This option will indicate, when gateway sender is started, should
we
> > >>>> discard/clean existing queue, or should we use existing queue.
> > >>>> By default it will be to discard/clean existing queue.
> > >>>>
> > >>>> Best Regards,
> > >>>> Mario
> > >>>> ________________________________
> > >>>> Šalje: Mario Ivanac <mario.ivanac@est.tech>
> > >>>> Poslano: 8. studenog 2019. 13:00
> > >>>> Prima: dev@geode.apache.org <dev@geode.apache.org>
> > >>>> Predmet: Odg: gateway sender queue
> > >>>>
> > >>>> Hi all,
> > >>>>
> > >>>> one more clarification regarding 3rd question:
> > >>>>
> > >>>> "*   Could we add extra option in gfsh command  "start gateway
> sender"
> > >>>>       that allows to control queues reset (for instance
> > --cleanQueues)"
> > >>>>
> > >>>> This option will indicate, when gateway sender is started, should
we
> > >>>> discard/clean existing queue, or should we use existing queue.
> > >>>> By default it will be to discard/clean existing queue.
> > >>>>
> > >>>> Best Regards,
> > >>>> Mario
> > >>>> ________________________________
> > >>>> Šalje: Mario Ivanac <mario.ivanac@est.tech>
> > >>>> Poslano: 7. studenog 2019. 9:01
> > >>>> Prima: Dan Smith <dsmith@pivotal.io>; dev@geode.apache.org
<
> > >>>> dev@geode.apache.org>
> > >>>> Predmet: Odg: gateway sender queue
> > >>>>
> > >>>> Hi,
> > >>>>
> > >>>> thanks for answers.
> > >>>>
> > >>>> Some more details regarding 1st question.
> > >>>>
> > >>>> Is this behavior same (for serial and parallel gateway sender)
in
> case
> > >>>> queue is persistent?
> > >>>> Meaning, should queue (persistent) be purged if we restart gateway
> > >>> sender?
> > >>>>
> > >>>> Thanks,
> > >>>> Mario
> > >>>>
> > >>>> ________________________________
> > >>>> Šalje: Dan Smith <dsmith@pivotal.io>
> > >>>> Poslano: 5. studenog 2019. 18:52
> > >>>> Prima: dev@geode.apache.org <dev@geode.apache.org>
> > >>>> Predmet: Re: gateway sender queue
> > >>>>
> > >>>> Some replies, inline:
> > >>>>
> > >>>>    *   During testing we have observed, different behavior in
> parallel
> > >> and
> > >>>>> serial gateway senders. In case we manually stop, than start
> gateway
> > >>>>> senders, for parallel gateway senders, queue is purged, but
for
> > >> serial
> > >>>>> gateway senders this is not the case. Is this normal behavior
or
> bug?
> > >>>>>
> > >>>> Hmm, I also think stop is supposed to clear the queue. I think
if
> you
> > >> are
> > >>>> seeing that it doesn't clear the queue, that might be a bug.
> > >>>>
> > >>>>
> > >>>>
> > >>>>>    *   What happens with the queues when whole cluster is stopped
> and
> > >>>> later
> > >>>>> started (In our tests with persistent queues, the events are
kept)?
> > >>>>>
> > >>>> Persistent queues will keep all of the events when you restart.
> > >>>>
> > >>>>
> > >>>>>    *   Could we add extra option in gfsh command  "start gateway
> > >> sender"
> > >>>>> that allows to control queues reset (for instance --cleanQueues)?
> > >>>>>
> > >>>> If stop does clear the queue, would this be needed? It might still
> be
> > >>>> reasonable - I've heard folks request a way to clear running queues
> as
> > >>>> well.
> > >>>>
> > >>>> -Dan
> > >>>>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message