Mailing-List: contact dev-help@drill.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@drill.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CANpYToeOAupe3nUAJXcotQHb3rgLVh5jSD4TFyKPu-K4c0MFSQ@mail.gmail.com>
References: 
 <DM2PR0601MB1104ECCDA3B9627452488D91FA3D0@DM2PR0601MB1104.namprd06.prod.outlook.com>
	<CACAwhF=nWDv0UZwmSWfJa0cRAqyyx+aC230pJmS2a=n12up37w@mail.gmail.com>
	<FCF963F2-2D10-4033-90D0-8F768659C411@hydromatic.net>
	<CANpYTofp9XtrhsFMOfP3ChQ2L_5TOmiW+j30stAkVYWhzkzF3g@mail.gmail.com>
	<53EC4E26-4E2E-4FEC-A6E4-18418D170A52@gmail.com>
	<CANpYToeOAupe3nUAJXcotQHb3rgLVh5jSD4TFyKPu-K4c0MFSQ@mail.gmail.com>
Date: Sun, 18 Oct 2015 17:41:12 +0200
Message-ID: 
 <CA+U3tt83vzjqAJsUz2ngC10fh7bN=gwXetyQdaFBnR2+cktDcA@mail.gmail.com>
Subject: Re: Apache Drill
From: =?UTF-8?Q?Kasper_S=C3=B8rensen?= <i.am.kasper.sorensen@gmail.com>
To: dev@drill.apache.org
Content-Type: multipart/alternative; boundary=e89a8f234c03c46079052262db6e

--e89a8f234c03c46079052262db6e
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi there,

Sorry for barging in, but maybe this is a place where Drill and MetaModel
could benefit from each other? We've considered that before at least ...

MetaModel already has support for both DOM and SAX based XML querying. They
basically inherit some characteristics from DOM and SAX respectively:

 - In the DOM variant we can infer a schema and all the user has to do is
select a XML file/resource anywhere.
 - In the SAX variant the user has to specify which paths in the XML
document should represent logical "tables" and what paths represent their
columns.

See [1] for more info. Hope this might be of interest to integrate into
Drill?

Best regards,
Kasper S=C3=B8rensen (from the MetaModel project)

[1] http://wiki.apache.org/metamodel/examples/XmlTableMapping

2015-10-18 0:35 GMT+02:00 Magnus Pierre <mpierre@maprtech.com>:

> Well, very few lines of code imho. And simple. Been able to parse pretty
> deep structures with no issues so far. Performance? 10-15 5mb xml's in le=
ss
> than a second on my laptop but then I run it using Storm with some
> parallelism in place. Don't know if it's good or bad. I'll share the code
> next time I use computer. You don't need to use it, but it works at least=
.
>
> /M
> Den 17 okt 2015 10:43 em skrev "Matt Burgess" <mattyb149@gmail.com>:
>
> > If the converter is clean and performant then I'm sure the community
> > (including me) is interested :)
> >
> > However I wonder if Drill can afford to add a translation layer between
> > data formats, could we be better served with similar parsing in Drill f=
or
> > XML as we do for JSON, or can it be pushed down far enough (to the
> parser)
> > to not make a noticeable difference (which is what I think Julian is
> > implying)?
> >
> > Sent from my iPhone
> >
> > > On Oct 17, 2015, at 1:41 PM, Magnus Pierre <mpierre@maprtech.com>
> wrote:
> > >
> > > Hello,
> > >
> > > Just wrote a simple sax implementation that converts xml to json and
> that
> > > is able to deal with decently complex xml's, that I currently use in
> > Storm.
> > > Takes attributes, and everything.
> > >
> > > I can share it with the community if interesting.
> > >
> > > /Magnus
> > > Den 17 okt 2015 7:02 em skrev "Julian Hyde" <julian@hydromatic.net>:
> > >
> > >> Seems to me the biggest problem is to make drill understand the nest=
ed
> > >> structure of an xml document. That work has been done for json, so
> let's
> > >> build on it. Suppose there was a translator that converted xml to js=
on
> > >> (adding attributes for things that json lacks, such as namespaces,
> text,
> > >> element tags). Drill knows how to handle json, even if it is a bit
> > verbose.
> > >> The translator could be applied on the fly.
> > >>
> > >> Julian
> > >>
> > >>
> > >>
> > >> Sent from my iPad
> > >>>> On Oct 16, 2015, at 2:31 PM, Stef=C3=A1n Baxter <
> stefan@activitystream.com
> > >
> > >>> wrote:
> > >>>
> > >>> Hi,
> > >>>
> > >>> It's not possible but there has been some talk here about supportin=
g
> > it.
> > >>> If I remember correctly it's rather complicated and not really
> > feasible.
> > >>> (I'm just a newbie so don't take my words for it)
> > >>>
> > >>>
> > >>> Regards,
> > >>> -Stefan
> > >>>
> > >>> On Fri, Oct 16, 2015 at 8:54 PM, Daniel Ajo <
> > Daniel.Ajo@abarcahealth.com
> > >>>
> > >>> wrote:
> > >>>
> > >>>> Hey there,
> > >>>>
> > >>>> I was wondering if it is possible to query XML files using Apache
> > Drill?
> > >>>>
> > >>>> I see there are several formats, and maybe it would work using an
> > xpath
> > >>>> query of some sorts, but just wondering if it would work to direct=
ly
> > >> query
> > >>>> it using some sort of plug-in.
> > >>>>
> > >>>> Well, let me know,
> > >>>>
> > >>>> Daniel Ajo
> > >>>> *********************************************************
> > >> CONFIDENTIALITY
> > >>>> NOTE: This electronic transmission contains information belonging =
to
> > >> Abarca
> > >>>> Health LLC, which is confidential or legally privileged. If you ar=
e
> > not
> > >> the
> > >>>> intended recipient, please immediately advise the sender by reply
> > >> e-mail or
> > >>>> telephone that this message has been inadvertently transmitted to
> you
> > >> and
> > >>>> delete this e-mail from your system. If you have received this
> > >> transmission
> > >>>> in error, you are hereby notified that any disclosure, copying,
> > >>>> distribution or the taking of any action in reliance on the conten=
ts
> > of
> > >> the
> > >>>> information is strictly prohibited.
> > >>
> >
>

--e89a8f234c03c46079052262db6e--