flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Artem Tsikiridis <tseki...@gmail.com>
Subject Re: [jira] [Commented] (FLINK-838) GSoC Summer Project: Implement full Hadoop Compatibility Layer for Stratosphere
Date Tue, 10 Jun 2014 08:00:50 GMT
Hello Robert,

Yes, I have access to an Openstack-based private cloud. An ok quota I can
have in this one is 3-4 machines max. You think that's ok?


On Tue, Jun 10, 2014 at 9:27 AM, Robert Metzger (JIRA) <jira@apache.org>
wrote:

>
>     [
> https://issues.apache.org/jira/browse/FLINK-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026204#comment-14026204
> ]
>
> Robert Metzger commented on FLINK-838:
> --------------------------------------
>
> Hi Artem, thanks for adopting to our new infrastructure and name so
> quickly!
> I'm happy to see that you are planning to add tests! Thats very important
> for us, since we are aiming to produce very stable code ;).
> Very cool that you've managed to map the counters to our accumulators.
>
>
> Do you have access to a real cluster? At some point, we certainly have to
> test your code in a distributed setup as well. I'll see if I can give you
> access to my Amazon AWS account so that you can use Amazon EMR. I'll also
> ask around at my university if there is a way to give you access.
>
> > GSoC Summer Project: Implement full Hadoop Compatibility Layer for
> Stratosphere
> >
> -------------------------------------------------------------------------------
> >
> >                 Key: FLINK-838
> >                 URL: https://issues.apache.org/jira/browse/FLINK-838
> >             Project: Flink
> >          Issue Type: Improvement
> >            Reporter: GitHub Import
> >              Labels: github-import
> >             Fix For: pre-apache
> >
> >
> > This is a meta issue for tracking @atsikiridis progress with
> implementing a full Hadoop Compatibliltiy Layer for Stratosphere.
> > Some documentation can be found in the Wiki:
> https://github.com/stratosphere/stratosphere/wiki/%5BGSoC-14%5D-A-Hadoop-abstraction-layer-for-Stratosphere-(Project-Map-and-Notes)
> > As well as the project proposal:
> https://github.com/stratosphere/stratosphere/wiki/GSoC-2014-Project-Proposal-Draft-by-Artem-Tsikiridis
> > Most importantly, there is the following **schedule**:
> > *19 May - 27 June (Midterm)*
> > 1) Work on the Hadoop tasks, their Context and the mapping of Hadoop's
> Configuration to the one of Stratosphere. By successfully bridging the
> Hadoop tasks with Stratosphere, we already cover the most basic Hadoop
> Jobs. This can be determined by running some popular Hadoop examples on
> Stratosphere (e.g. WordCount, k-means, join) (4 - 5 weeks)
> > 2) Understand how the running of these jobs works (e.g. command line
> interface) for the wrapper. Implement how will the user run them. (1 - 2
> weeks).
> > *27 June - 11 August*
> > 1) Continue wrapping more "advanced" Hadoop Interfaces (Comparators,
> Partitioners, Distributed Cache etc.) There are quite a few interfaces and
> it will be a challenge to support all of them. (5 full weeks)
> > 2) Profiling of the application and optimizations (if applicable)
> > *11 August - 18 August*
> > Write documentation on code, write a README with care and add more
> unit-tests. (1 week)
> > ---------------- Imported from GitHub ----------------
> > Url: https://github.com/stratosphere/stratosphere/issues/838
> > Created by: [rmetzger|https://github.com/rmetzger]
> > Labels: core, enhancement, parent-for-major-feature,
> > Milestone: Release 0.7 (unplanned)
> > Created at: Tue May 20 10:11:34 CEST 2014
> > State: open
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.2#6252)
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message