Mailing-List: contact user-help@cayenne.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cayenne.apache.org
From: "Musall, Maik" <maik@selbstdenker.ag>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\))
Subject: Fetching lots of objects
Message-Id: <A9A5FD10-FB5D-47CC-8B1F-A7B639F0A866@selbstdenker.ag>
Date: Mon, 6 Mar 2017 22:25:15 +0100
To: user@cayenne.apache.org
archived-at: Mon, 06 Mar 2017 21:25:29 -0000

Hi all,

I have a number of statistics functions which need to fetch large =
amounts of objects. I need the actual DataObjects because that's where =
the business logic is that I need for the computations.

Let's say I need to fetch 300.000 objects. Let's also assume the =
database sits on a fast SSD array and can serve multiple connections =
easily. I'm assuming in this case the CPU time needed for DataObject =
instantiation is the main performance constraint. Is that correct?

If so, how can I speed this up? Could I partition my fetch, and fetch in =
several threads in parallel into the same ObjectContext? Or is there an =
easier way to make use of multiple CPU cores for this?

Thanks
Maik