db-derby-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raymond Raymond" <raymond_de...@hotmail.com>
Subject RE: how does derby avoid eating up all the system resources if it's used embeddedly
Date Wed, 19 Oct 2005 07:38:42 GMT
<html><div style='background-color:'><DIV class=RTE>
<P><BR><BR></P>Hi, Dear Mike, since you said "Are there any opinions
out there on </DIV>how to determine if Derby "is busy"?&nbsp;&nbsp;" and it
is not good for derby
<DIV></DIV>to eat up all the system resources, I am curious to know presently
<DIV></DIV>how does derby avoid eating up all the system resources if it can't
<DIV></DIV>dertermine it's busy or not? <FONT color=#ff0033>especially the
disk IO and cpu usage</FONT><FONT color=#ff0000>.</FONT>
<DIV></DIV>
<DIV></DIV>Thanks.
<DIV></DIV>
<DIV></DIV>Raymond
<DIV></DIV>
<DIV></DIV>&gt;&gt;From: Mike Matrigali
<DIV></DIV>&gt;&gt;Reply-To: "Derby Development"
<DIV></DIV>&gt;&gt;To: Derby Development
<DIV></DIV>&gt;&gt;Subject: Re: Some idea about checkpoint issue, welcome
to give your
<DIV></DIV>&gt;&gt;idea
<DIV></DIV>&gt;&gt;Date: Tue, 11 Oct 2005 10:57:08 -0700
<DIV></DIV>&gt;&gt;
<DIV></DIV>&gt;&gt;Are there any opinions out there on how to determine
if
<DIV></DIV>&gt;&gt;Derby "is busy"?&nbsp;&nbsp;Is there something
better than just having
<DIV></DIV>&gt;&gt;a low priority thread&nbsp;&nbsp;and maybe
some query of cpu vs. elapsed
<DIV></DIV>&gt;&gt;time?
<DIV></DIV>&gt;&gt;
<DIV></DIV>&gt;&gt;The first problem is that I don't think there are great
tools
<DIV></DIV>&gt;&gt;for this in java.&nbsp;&nbsp;The second problem
is that often Derby is
<DIV></DIV>&gt;&gt;meant to be embedded as part of another application,
so we have
<DIV></DIV>&gt;&gt;to be careful not to implement a standard server based
approach
<DIV></DIV>&gt;&gt;where it is appropriate for the "server" to use up
all resources
<DIV></DIV>&gt;&gt;available (ie. idle time may not really be best used
by derby
<DIV></DIV>&gt;&gt;admin processes).
<DIV></DIV>&gt;&gt;
<DIV></DIV>&gt;&gt;I have not come up with a good answer to this problem,
there are
<DIV></DIV>&gt;&gt;a number of things derby could do if it knew it had
idle time
<DIV></DIV>&gt;&gt;available for it's use.&nbsp;&nbsp;Best I have
come up with is some mode
<DIV></DIV>&gt;&gt;in the system that needs to be set by the application
which
<DIV></DIV>&gt;&gt;starts up Derby - either derby try's to limit it's
use of idle
<DIV></DIV>&gt;&gt;cycles or it enabled to try and schedule work during
idle time.
<DIV></DIV>&gt;&gt;
<DIV></DIV>&gt;&gt;Raymond Raymond wrote:
<DIV></DIV>&gt;&gt;
<DIV></DIV>&gt;&gt; &gt; I have been thinking of the automatic checkpointing
issue
<DIV></DIV>&gt;&gt; &gt; recently.I also find someone added another
issue about "Use
<DIV></DIV>&gt;&gt; &gt; of idle time for background checkpoint" into
the to-do list.
<DIV></DIV>&gt;&gt; &gt; I think we can consider these two issue together.
I have
<DIV></DIV>&gt;&gt; &gt; some idea about it.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt; Instead of doing checkpoint periodically
and trying to tune the
<DIV></DIV>&gt;&gt; &gt; checkpoint interval to achieve best performance,
is it possible
<DIV></DIV>&gt;&gt;to
<DIV></DIV>&gt;&gt; &gt; keep the background checkpoint process running
to do checkpoint,
<DIV></DIV>&gt;&gt; &gt; and the DBMS can tune the rate of checkpoint
depending on the
<DIV></DIV>&gt;&gt; &gt; current system situation,e.g. if the system
is busy, derby will
<DIV></DIV>&gt;&gt; &gt; slow down the checkpoint rate and if the
system is not
<DIV></DIV>&gt;&gt;busy(idle),
<DIV></DIV>&gt;&gt; &gt; derby will speed up the checkpoint rate.We
will update the
<DIV></DIV>&gt;&gt;control
<DIV></DIV>&gt;&gt; &gt; file periodically to let the DBMS know up
to where we did
<DIV></DIV>&gt;&gt;checkpoint.
<DIV></DIV>&gt;&gt; &gt; Maybe we can call it 'increamental checkpointing'.
In my
<DIV></DIV>&gt;&gt;opinion,
<DIV></DIV>&gt;&gt; &gt; this approach can use the disk IO resources
with reason if we
<DIV></DIV>&gt;&gt;can
<DIV></DIV>&gt;&gt; &gt; decide the checkpoint rate reasonablly.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt; I would like to discuss this issue with everyone.
I am not
<DIV></DIV>&gt;&gt; &gt; sure if this approach is doable or not. If
it is doable, I will
<DIV></DIV>&gt;&gt; &gt; have some further questions about how to
decide the appropriate
<DIV></DIV>&gt;&gt; &gt; checkpoint rate.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt; Thanks.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt; Yours, Raymond
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt;_________________________________________________________________
<DIV></DIV>&gt;&gt; &gt; Designer Mail isn't just fun to send, it's
fun to receive. Use
<DIV></DIV>&gt;&gt;special
<DIV></DIV>&gt;&gt; &gt; stationery, fonts and colors.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt;http://join.msn.com/?pgmarket=en-ca&amp;page=byoa/prem&amp;xAPID=1994&amp;DI=1034&amp;SU=http://hotmail.com/enca&amp;HL=Market_MSNIS_Taglines
<DIV></DIV>&gt;&gt; &gt;&nbsp;&nbsp;Start enjoying all the
benefits of MSN?Premium right now and
<DIV></DIV>&gt;&gt;get the
<DIV></DIV>&gt;&gt; &gt; first two months FREE*.
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;&gt; &gt;
<DIV></DIV>&gt;
<DIV></DIV>&gt;_________________________________________________________________
<DIV></DIV>&gt;Take charge with a pop-up guard built on patented Microsoft?
<DIV></DIV>&gt;SmartScreen Technology&nbsp;&nbsp;
<DIV></DIV>&gt;http://join.msn.com/?pgmarket=en-ca&amp;page=byoa/prem&amp;xAPID=1994&amp;DI=1034&amp;SU=http://hotmail.com/enca&amp;HL=Market_MSNIS_Taglines
<DIV></DIV>&gt;&nbsp;&nbsp;Start enjoying all the benefits of MSN?Premium
right now and get
<DIV></DIV>&gt;the first two months FREE*.
<DIV></DIV>&gt; </div><br clear=all><hr>Don't just Search.
Find! <a href="http://g.msn.com/8HMAENCA/2749??PS=47575" target="_top">The new MSN Search:
</a> Fast. Clear. Easy.</html>


Mime
View raw message