Mailing-List: contact dev-help@zest.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@zest.apache.org
MIME-Version: 1.0
Sender: hedhman@gmail.com
In-Reply-To: <tencent_71AFD7A34278D2F17D803B0F@qq.com>
References: <tencent_662F10C64B172B3260801136@qq.com> <CADmm+Ke1QLK_yKAqAn2+puXqHsL8Z3KctYPhUDnQcp-FoBC5mw@mail.gmail.com>
 <tencent_71AFD7A34278D2F17D803B0F@qq.com>
From: Niclas Hedhman <niclas@hedhman.org>
Date: Tue, 14 Jun 2016 18:01:52 +0800
Message-ID: <CADmm+KdipzQB=1fZmb80N5uxYw-5dpV=XOykuR8WABi6TxfwxQ@mail.gmail.com>
Subject: Re: Python Interface
To: dev <dev@zest.apache.org>
Content-Type: multipart/alternative; boundary=001a11433b2042afa705353a1973
archived-at: Tue, 14 Jun 2016 10:02:19 -0000

--001a11433b2042afa705353a1973
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

If you would like to flesh out the details, and want some help to make it a
bit more formal language (in case you struggle expressing yourself in
English), I'd be happy to assist to make it into a formal documentation
page (probably 2 diff pages) on it.

Niclas

On Tue, Jun 14, 2016 at 5:54 PM, zhuangmz08 <zhuangmz08@qq.com> wrote:

> Yes, I look at the samples before. I wrote this email to ensure whether
> there's a format guide.
>
>
>
>
> ------------------ =E5=8E=9F=E5=A7=8B=E9=82=AE=E4=BB=B6 -----------------=
-
> =E5=8F=91=E4=BB=B6=E4=BA=BA: "Niclas Hedhman";<niclas@hedhman.org>;
> =E5=8F=91=E9=80=81=E6=97=B6=E9=97=B4: 2016=E5=B9=B46=E6=9C=8814=E6=97=A5(=
=E6=98=9F=E6=9C=9F=E4=BA=8C) =E4=B8=8B=E5=8D=885:49
> =E6=94=B6=E4=BB=B6=E4=BA=BA: "dev"<dev@zest.apache.org>;
>
> =E4=B8=BB=E9=A2=98: Re: Python Interface
>
>
>
> Pandas DataFrame ??? No idea what that is...
>
> We have not written a Guide for the internal storage format of the
> MapEntityStore or even the ValueSerialization subsystem.
>
> But it is very straight forward; There are a handful of fields in the
> "root" object, i.e. metadata about the object, such as identity,
> lastModified, version number and so on. Then there are four fields in the
> root object named; properties, assocations, manyassociations,
> namedassociations, which contains entries with the "name" (the method nam=
e)
> as the key and the value being the serialized form of each of those state=
s.
>
> It is pretty clear if you look at a capture sample;
>
> {
>   "associations": {},
>   "identity": "97d21d04-58c4-44a9-bd6c-1f861cf0a1f9-0",
>   "modified": 1465718396917,
>   "namedassociations": {},
>   "type": "org.apache.zest.index.solr.SolrQueryServiceTest$TestEntity",
>   "version":
> "MemoryEntityStoreService-d10f4fd5-da9a-4e56-9476-a1750c9509f10",
>   "manyassociations": {},
>   "properties": {
>     "identity": "97d21d04-58c4-44a9-bd6c-1f861cf0a1f9-0",
>     "name": "Hello World"
>   },
>   "application_version": "1.0"
> }
>
> In this example, there are no associations, but they are referencing
> Identities, directly, List or Map form. The properties here are very
> simple, only a
>     Property<String> identity();  // part of the Identity interface
>     Property<String> name();  // from somewhere...
>
> So, to use this in another platform should be pretty simple if there is
> JSON support.
>
> Indexing format is a lot more complex, and is very different between
> Indexing engines. There is no equivalent "unifying" intermediary, as we
> have in the MapEntityStore.
>
>
> Cheers
> Niclas
>
> On Tue, Jun 14, 2016 at 3:37 PM, zhuangmz08 <zhuangmz08@qq.com> wrote:
>
> > Hi,
> >
> >
> > I have some written python scripts, which consums data from former
> > database. Now, I would like to switch the former database into a domain
> > designed database, which is the mongo Map Entity Store. And I also like
> to
> > use ONLY one domain model across multi language platform.
> > I have some follwing questions:
> > 1. Is there any exist python interface to read database into pandas
> > DataFrame? I'm afraid not....
> > 2. If I write my own python interface, I would have to know the Entity
> > Format, since my interface exposes to this format. Is there explicit
> format
> > guide?
> >
> >
> > Thanks a lot.
>
>
>
>
> --
> Niclas Hedhman, Software Developer
> http://zest.apache.org - New Energy for Java
>


--=20
Niclas Hedhman, Software Developer
http://zest.apache.org - New Energy for Java

--001a11433b2042afa705353a1973--