Return-Path: X-Original-To: apmail-zest-dev-archive@minotaur.apache.org Delivered-To: apmail-zest-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3672718956 for ; Tue, 15 Dec 2015 04:46:08 +0000 (UTC) Received: (qmail 7652 invoked by uid 500); 15 Dec 2015 04:46:08 -0000 Delivered-To: apmail-zest-dev-archive@zest.apache.org Received: (qmail 7613 invoked by uid 500); 15 Dec 2015 04:46:08 -0000 Mailing-List: contact dev-help@zest.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@zest.apache.org Delivered-To: mailing list dev@zest.apache.org Received: (qmail 7601 invoked by uid 99); 15 Dec 2015 04:46:07 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 04:46:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2F3D31A047C for ; Tue, 15 Dec 2015 04:46:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3 X-Spam-Level: *** X-Spam-Status: No, score=3 tagged_above=-999 required=6.31 tests=[AC_DIV_BONANZA=0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id VaepUfClF_g5 for ; Tue, 15 Dec 2015 04:46:00 +0000 (UTC) Received: from mail-lb0-f171.google.com (mail-lb0-f171.google.com [209.85.217.171]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 6294925DEA for ; Tue, 15 Dec 2015 04:45:56 +0000 (UTC) Received: by lbblt2 with SMTP id lt2so120860717lbb.3 for ; Mon, 14 Dec 2015 20:45:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=MWegnrwSnnuXChAqHs4AQW/3zoMsMwhQWLHc6wtIUz0=; b=xF8BKSFeHYPD6OjbKd3b4iP5NsOaJjqN9wZDl809+9tL2GF2aQudCnmr19Kz2HD6/H c6OK5FlxzDIOprdf0ArL+3W6QJqRXsFNJ3U0Kcab+XXmyPdxDv2Hq8/Jf+J6929B8BNy 4GAcnE1BJmuqUrQnnSkFHgSOr2zV+PATh6O41ikqbZNmq/C1QhwXPUxd+ydGIWUZFGP8 YnoQNgN8PednBPSVdbSsLbHRBmVe+m6GkkKAmptwiPHJz0SuY4qg6fNpKxygL5XlZspc +yXLCNopONgyVsJcs8usSA9RUoMOWI/C4v0uK3ddhg6+bvP6vEfRd585PV/RY/4ZIKxA +3Dg== X-Received: by 10.112.52.105 with SMTP id s9mr14638603lbo.97.1450154749798; Mon, 14 Dec 2015 20:45:49 -0800 (PST) MIME-Version: 1.0 Sender: hedhman@gmail.com Received: by 10.25.21.226 with HTTP; Mon, 14 Dec 2015 20:45:30 -0800 (PST) In-Reply-To: <566E59BF.2030207@gmail.com> References: <566D4467.1030108@gmail.com> <566DE323.2080503@gmail.com> <566E59BF.2030207@gmail.com> From: Niclas Hedhman Date: Tue, 15 Dec 2015 12:45:30 +0800 X-Google-Sender-Auth: 7L-M1lfXX2wCI81Ue-_rqHQJeas Message-ID: Subject: Re: Inconsistency between indexers and stores? To: dev Content-Type: multipart/alternative; boundary=001a11c3f502bb34330526e876a6 --001a11c3f502bb34330526e876a6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Ok, so I have created a Multi-layered testing framework for Indexing/Query, but only populated two simple testcases. Access Layer DomainLayer PersistenceLayer IndexingLayer and then a ConfigLayer under both the Persistence and Indexing, which might not be needed. I think the EntityStore should not need to have Visibiilty of Indexer (org.apache.zest.spi.entitystore.StateChangeListener) and instead I think it should be from the point of view of the UnitOfWork, i.e. the Module, performing the "store+index" operation. And it is for that reason, the test is setup so that the DomainLayer has the Persistence and the Indexing in separate layers, so they can't see each other. What I would REALLY like to get help with, is to "convert" the many indexing/query test cases to this new structure. For each @Test method in the old tests, a. Create a TestCase 'service' by modifying the TestSuite1Module b. Add a field for it in AbstractMultiLayeredIndexingTest c. Create a @Test method in AbstractMultiLayeredIndexingTest So, what is next? Kent suggested that UnitOfWork should have a better grip on the whole Indexing/Query process, and I agree. I am also keen on making UnitOfWork a user-defined composite in itself, and will look into what is required for that. I think it is simply a matter of looking up the UnitOfWorkFactory as a regular service, some convenience classes, and possibly more access to the internals via the ZestSPI. Niclas On Mon, Dec 14, 2015 at 1:55 PM, Kent S=C3=B8lvsten wrote: > Den 14-12-2015 kl. 03:55 skrev Niclas Hedhman: > > I think that the key to solving this problem is creation of testcases > that > > highlights the many problems. And I don't think I am capable of making > > those on my own, we need a collaborative effort here... > > > > Soooo, I have pushed a new branch ZEST-132, which currently is 'develop= ', > > but I want this branch to get new testcases which shows all the problem= s > in > > the current Indexing/Query semantics. Of course, those testcases will b= e > > failing and that is the whole point of bringing this out of the 'develo= p' > > branch. > > > > WDYT? > Agreed. > > I have previously created the first testcases regarding querying in a > multi-module zest-deployment. But those are more reflecting the state > "as-is" instead of "as-wanted". > > See for example RdfQueryMultiModuleTest. > > We could definitely use much more tests using multiple modules. > > I would be delighted if you could write the Visibiility section in the > > core/api/src/docs/structure.txt. It is currently empty, and it needs so= me > > love... > > > > I think I will look into this soon-ish. I have created > > https://issues.apache.org/jira/browse/ZEST-132 to track it. > > > I will do that > > /Kent > --=20 Niclas Hedhman, Software Developer http://zest.apache.org - New Energy for Java --001a11c3f502bb34330526e876a6--