oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aditya Dhulipala <adhul...@usc.edu>
Subject Re: GSoC 2015
Date Wed, 11 Feb 2015 07:05:45 GMT
​Hi Lewis,

Thanks for the info!

I've been looking at the code you've posted above and trying to get a sense
of what it does.
I'm looking through the imports and I found some schema definitions in
XmlStructFactory & XmlRpcStructFactory  make this suitable for transfer
over xml-rpc.

My guess is that this project would be to write .avpr files (Avro files)
that define these file manager structs & then replace all the xml-rpc
(XmlStructFactory & XmlRpcStructFactory) with Avro specific implementations
like this
https://github.com/phunt/avro-rpc-quickstart

I understand what Avro is and how its better than xmlrpc for performance
reasons. I'm interested in reading more about this topic. And in particular
how it affects various components of OODT.

Can you point me in the right direction?

Thanks!

--
Aditya



On Mon, Feb 9, 2015 at 11:27 AM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:

> Hi Aditya,
> I would suggest that you get to grips with the XmlRpcFileManager [0] to
> begin with within the FileMgr component.
> Is anyone aware of existing documentation for the XMLRPC implementations
> within FileMgr right now?
> Thanks
> Lewis
>
> [0]
>
> https://github.com/apache/oodt/blob/trunk/filemgr/src/main/java/org/apache/oodt/cas/filemgr/system/XmlRpcFileManager.java
>
> On Mon, Feb 9, 2015 at 10:50 AM, Aditya Dhulipala <adhulipa@usc.edu>
> wrote:
>
> > Hi Lewis,
> >
> > I just read your email about OODT's RPC revamp. I've been reading up on
> > Avro, Thrift and Proto buffers and I'm interested in that area.
> >
> > But I dont really have a guru level understanding of the subject. Can you
> > point me to some documentation on the issue?
> >
> > https://cwiki.apache.org/confluence/display/OODT/Apache+OODT+APIs
> > I found this at the OODT wiki page. But it doesn't really have much info
> > other than these links to the source code.
> >
> > Thanks!
> >
> > --
> > Aditya
> >
> >
> >
> > adi
> >
> > On Mon, Feb 9, 2015 at 9:45 AM, Lewis John Mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > Hi Valerie,
> > > Sorry for that
> > > https://www.google-melange.com/gsoc/homepage/google/gsoc2015
> > > "Google Summer of Code is a global program that offers students
> stipends
> > to
> > > write code for open source projects. We have worked with the open
> source
> > > community to identify and fund exciting projects for the upcoming
> > summer."
> > >
> > > On Mon, Feb 9, 2015 at 9:07 AM, Mallder, Valerie <
> > > Valerie.Mallder@jhuapl.edu
> > > > wrote:
> > >
> > > > Since I don't know what GSoC is, I have no good ideas :)
> > > >
> > > >
> > > > Valerie A. Mallder
> > > > New Horizons Deputy Mission System Engineer
> > > > Johns Hopkins University/Applied Physics Laboratory
> > > >
> > > >
> > > > > -----Original Message-----
> > > > > From: Mattmann, Chris A (3980) [mailto:
> chris.a.mattmann@jpl.nasa.gov
> > ]
> > > > > Sent: Saturday, February 07, 2015 1:21 AM
> > > > > To: dev@oodt.apache.org
> > > > > Subject: FW: GSoC 2015
> > > > >
> > > > > We should be thinking about GSoC on OODT, any ideas?
> > > > >
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > > Chris Mattmann, Ph.D.
> > > > > Chief Architect
> > > > > Instrument Software and Science Data Systems Section (398) NASA Jet
> > > > > Propulsion Laboratory Pasadena, CA 91109 USA
> > > > > Office: 168-519, Mailstop: 168-527
> > > > > Email: chris.a.mattmann@nasa.gov
> > > > > WWW:  http://sunset.usc.edu/~mattmann/
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > > Adjunct Associate Professor, Computer Science Department University
> > of
> > > > > Southern California, Los Angeles, CA 90089 USA
> > > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > > > > +++++
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Lewis John Mcgibbney <lewis.mcgibbney@gmail.com>
> > > > > Reply-To: "dev@nutch.apache.org" <dev@nutch.apache.org>
> > > > > Date: Wednesday, February 4, 2015 at 2:42 PM
> > > > > To: "dev@nutch.apache.org" <dev@nutch.apache.org>
> > > > > Subject: GSoC 2015
> > > > >
> > > > > >Hi Folks,
> > > > > >
> > > > > >Does anyone have any good ideas for GSoC?
> > > > > >
> > > > > >Seb mentioned moving Nutch towards Spark so potentially a
> pluggable
> > > > > >runtime execution engine abstraction?
> > > > > >
> > > > > >I am currently working on a lot of security and authentication
> > related
> > > > > >work so I would possibly be tempted to overhaul and improve that
> > > aspect
> > > > > >of Nutch.
> > > > > >
> > > > > >Any other ideas?
> > > > > >
> > > > > >Thanks folks
> > > > > >Lewis
> > > > > >
> > > > > >--
> > > > > >Lewis
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message