asterixdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Carey <mjca...@ics.uci.edu>
Subject Fwd: Re: Migration of git repository
Date Tue, 21 Apr 2015 15:53:40 GMT
Retrying minus the attachment (which is available anyway as the first 
publication on the Pregelix site's publications page).


-------- Forwarded Message --------
Subject: 	Re: Migration of git repository
Date: 	Tue, 21 Apr 2015 08:49:59 -0700
From: 	Michael Carey <mjcarey@ics.uci.edu>
To: 	Mattmann, Chris A (3980) <chris.a.mattmann@jpl.nasa.gov>, Till 
Westmann <till@westmann.org>
CC: 	Chris Hillery <chillery@lambda.nu>, Ian Maxon <imaxon@uci.edu>, 
Yingyi Bu <buyingyi@gmail.com>, dev@asterixdb.incubator.apache.org



Sure!  Let me clarify the issue for everyone (and broaden the question).

One of the technical by-products of the AsterixDB project is a graph 
analytics package called Pregelix - as the name suggests, it is a "knock 
off" of Pregel, as are packages like Giraph. What's unique about 
Pregelix is that it actually scales without OOM'ing - under the covers 
it uses database join processing techniques.  You can find out more 
about it by visiting http://pregelix.ics.uci.edu/ and/or by skimming the 
attached paper - check out the experimental results compared to other 
popular alternatives. Anyway, we have made it freely available (as we do 
all of our AsterixDB-related research products) and we were thinking 
that we should simply include it under the AsterixDB project - kind of 
like Spark has subprojects for SQL, streams, graphs, etc.  As a result, 
I listed it on the list of transferred artifacts when I sent in the 
licensing form the other day.  (So we at least have that step done.)  
Its code conntributors have been a small subset of the AsterixDB team; 
it was a small sub-project, basically.  (Mostly just Yingyi Bu!)

Pregelix is kind of a sibling of Apache VXQuery in that its runtime is 
based on Hyracks but it hasn't otherwise been AsterixDB-dependent.  
However, we have just finished teaching it to read/write directly from 
AsterixDB native storage - instead of just HDFS - so now it has an 
AsterixDB dependency, and we are using it as a driving example of how to 
couple AsterixDB to other analytic engines.

Rather than going through another exercise to open-source this 
separately, it seemed like we could take this approach.

Thoughts?
Cheers,
Mike


On 4/21/15 7:45 AM, Mattmann, Chris A (3980) wrote:
> Yes, in fact, this whole conversations should be happening on
> the dev list. OK for me to CC them on my reply?
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Chief Architect
> Instrument Software and Science Data Systems Section (398)
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 168-519, Mailstop: 168-527
> Email:chris.a.mattmann@nasa.gov
> WWW:http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Associate Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>
> -----Original Message-----
> From: "Michael J. Carey"<mjcarey@ics.uci.edu>
> Date: Tuesday, April 21, 2015 at 3:13 AM
> To: Till Westmann<till@westmann.org>
> Cc: Chris Hillery<chillery@lambda.nu>, Ian Maxon<imaxon@uci.edu>, Yingyi
> Bu<buyingyi@gmail.com>, Chris Mattmann<Chris.A.Mattmann@jpl.nasa.gov>
> Subject: Re: Migration of git repository
>
>> + Yingyi on the Pregelix Q.  Should we also ask Chris M for advice on
>> that?
>> On Apr 20, 2015 4:23 PM, "Till Westmann"<till@westmann.org>  wrote:
>>
>> Hi Ian,
>>
>>
>> That’s a good question - and I don’t know the answer.
>> We’ve got 2 repos so far:
>> https://issues.apache.org/jira/browse/INFRA-9212
>> https://issues.apache.org/jira/browse/INFRA-9306
>> so we should have space for Hyracks and AsterixDB.
>>
>>
>> I think that there’s an open questions about Pregelix, but maybe that
>> shouldn’t keep us from going ahead.
>>
>>
>> I further think that it would be great if you could send an e-mail to
>> dev@asterixdb.incubator.apache.org
>> <mailto:dev@asterixdb.incubator.apache.org>  and ask if it’s ok to import
>> our git repo(s) or if something else needs to be done first. (I could
>> send that e-mail as well, but it would be great if there were more
>> non-Till e0mails on the list :) )
>>
>>
>> Cheers,
>> Till
>>
>>
>> On Apr 20, 2015, at 4:07 PM, Ian Maxon<imaxon@uci.edu>  wrote:
>>
>> Hi Mike, Chris and Till,
>>
>>
>> Since (I think?) the paperwork for the software grant is done now, should
>> I copy our GC branches over to the ASF git repositories now ( as well as
>> making it a mirror in the Gerrit commit hook script)?
>>
>>
>> Thanks,
>> - Ian
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>




Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message