lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toke Eskildsen ...@statsbiblioteket.dk>
Subject Re: Hardware Specs Question
Date Thu, 02 Sep 2010 08:54:51 GMT
On Thu, 2010-09-02 at 03:37 +0200, Lance Norskog wrote:
> I don't know how much SSD disks cost, but they will certainly cure the
> disk i/o problem.

We've done a fair amount of experimentation in this area (1997-era SSDs
vs. two 15.000 RPM harddisks in RAID 1 vs. two 10.000 RPM harddisks in
RAID 0). The harddisk setups never stood a chance for searching. With
current SSD's being faster than harddisks for writes too, they'll also
be better for index building, although not as impressive as for
searches. Old notes at http://wiki.statsbiblioteket.dk/summa/Hardware

With consumer level SSD's, there is more bang-for-the-buck than RAIDing
up with high-end harddisks. They should be the first choice when IO is
an issue.


There are of course opposing views on this issue. Some people think
enterprise: Expensive and very reliable systems where consumer hardware
is a big no-no. The price point for pro SSDs might make them unfeasible
in such a setup. Other go for cheaper setups and handle the reliability
issues with redundancy. I'm firmly in the second camp, but it is
obviously not an option for all people.

A point of concern is writes. Current consumer SSDs uses wear leveling
and they can take a lot of punishment (as a rough measurement: The
amount of free space times 10.000). They might not be suitable for
holding massive databases with thousands of writes/second, but they can
surely handle the measly amount of writes required for Lucene index
updating and searching.

A long story short: Put a quality consumer SSD in each server and be
happy.


Mime
View raw message