Mailing-List: contact modperl-help@perl.apache.org; run by ezmlm
Precedence: bulk
Received-SPF: pass (asf.osuosl.org: domain of willfould@gmail.com designates
 64.233.184.196 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=MRE+yoFRt1OVyGRvRRH5ik/bpBBIcoZ6oj2krZujHcAEq3r37ayyu3kC0gjtJq9E+2SyPHWTvdIOFte26dohJlhjw+eHO1u7ivbwt8fzYnim+j2zG/NMBr6aUR7w2E1LOAUXqcehWVkc14wCggu+1k5aUZtfuLBXyIYzLALPMH8=
Message-ID: <4b3372230603072116y67b07720j90a8041d07eefa55@mail.gmail.com>
Date: Tue, 7 Mar 2006 21:16:34 -0800
From: "Will Fould" <willfould@gmail.com>
To: modperl@perl.apache.org
Subject: Re: changing global data strategy
In-Reply-To: <4b3372230603072105l30e34a28v6861ddd209597f0c@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_10713_6299390.1141794994384"
References: <4b3372230603072105l30e34a28v6861ddd209597f0c@mail.gmail.com>

------=_Part_10713_6299390.1141794994384
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

at this point, the application is on a single machine, but I'm being tasked
with moving our database onto another machine and implement load balancing
b/w 2 webservers.

william


On 3/7/06, Will Fould <willfould@gmail.com> wrote:
>
>  an old issue:
>    "a dream solution would be if all child processes could *update* a
> large global structure."
>
> we have a tool that loads a huge store of data (25-50Mb+) from a
> database into many perl hashes at start up: each session needs access to =
all
> these data but it would be prohibitive to use mysql or another databases =
for
> multiple, large lookups (and builds), at each session:  there are quite a
> few structures, each are very big.
>
> if the data never changed, it would be trivial; load/build just at
> start-up.
>
> but since the data changes often, we use a semaphore strategy to determin=
e
> when childern should reload/rebuild the structures (after updates have be=
en
> made).
>
> this is painful. there has got to be a better way of doing this - I've
> seen posts on memcache and other, more exotic animals.
>
> can someone point me in the right direction: a reference/read, or a stabl=
e
> modules that exist for our situation?
>
>
> thanks in advance,
> william
>

------=_Part_10713_6299390.1141794994384
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

<div>at this point,&nbsp;the application&nbsp;is on a single machine, but I=
'm being tasked with moving our database&nbsp;onto another&nbsp;machine and=
 implement load balancing b/w 2&nbsp;webservers.&nbsp;<br>&nbsp;</div>
<div>william</div>
<div><br>&nbsp;</div>
<div><span class=3D"gmail_quote">On 3/7/06, <b class=3D"gmail_sendername">W=
ill Fould</b> &lt;<a href=3D"mailto:willfould@gmail.com">willfould@gmail.co=
m</a>&gt; wrote:</span>
<blockquote class=3D"gmail_quote" style=3D"PADDING-LEFT: 1ex; MARGIN: 0px 0=
px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">
<div style=3D"DIRECTION: ltr">
<div>an&nbsp;old&nbsp;issue:</div>
<div>&nbsp;&nbsp; &quot;a dream solution would be&nbsp;if all child process=
es&nbsp;could *update*&nbsp;a large global structure.&quot;</div>
<div>&nbsp;</div>
<div>we&nbsp;have a tool that loads a huge store of data (25-50Mb+) from a =
database&nbsp;into many perl hashes at start up: each session needs access&=
nbsp;to all these&nbsp;data&nbsp;but it&nbsp;would be prohibitive to use my=
sql or another databases for multiple,&nbsp;large lookups (and builds), at =
each session:&nbsp; there are quite a few structures, each are very big.=20
</div>
<div>&nbsp;</div>
<div>if the data never changed,&nbsp;it would&nbsp;be&nbsp;trivial; load/bu=
ild just at start-up.&nbsp;</div>
<div>&nbsp;</div>
<div>but since&nbsp;the data changes often, we use a semaphore strategy&nbs=
p;to determine when childern should&nbsp;reload/rebuild the structures (aft=
er updates have been made).</div>
<div>&nbsp;</div>
<div>this is painful. there has got to be a better way of doing this -&nbsp=
;I've seen posts on memcache and&nbsp;other, more exotic animals.</div>
<div>&nbsp;</div>
<div>can someone point me in the right direction: a reference/read, or a&nb=
sp;stable modules that exist for our situation?</div>
<div>&nbsp;</div>
<div>&nbsp;</div>
<div>thanks in advance, </div>
<div>william</div></div></blockquote></div><br>

------=_Part_10713_6299390.1141794994384--