Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0771B11403 for ; Wed, 13 Aug 2014 23:06:34 +0000 (UTC) Received: (qmail 13639 invoked by uid 500); 13 Aug 2014 23:06:33 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 13610 invoked by uid 500); 13 Aug 2014 23:06:33 -0000 Mailing-List: contact issues-help@flink.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.incubator.apache.org Delivered-To: mailing list issues@flink.incubator.apache.org Received: (qmail 13601 invoked by uid 99); 13 Aug 2014 23:06:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Aug 2014 23:06:33 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 13 Aug 2014 23:06:32 +0000 Received: (qmail 12037 invoked by uid 99); 13 Aug 2014 23:06:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Aug 2014 23:06:12 +0000 Date: Wed, 13 Aug 2014 23:06:12 +0000 (UTC) From: "Artem Tsikiridis (JIRA)" To: issues@flink.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-838) GSoC Summer Project: Implement full Hadoop Compatibility Layer for Stratosphere MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/FLINK-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096272#comment-14096272 ] Artem Tsikiridis commented on FLINK-838: ---------------------------------------- Wow great! Yes of course, I should do that. > GSoC Summer Project: Implement full Hadoop Compatibility Layer for Stratosphere > ------------------------------------------------------------------------------- > > Key: FLINK-838 > URL: https://issues.apache.org/jira/browse/FLINK-838 > Project: Flink > Issue Type: Improvement > Reporter: GitHub Import > Labels: github-import > Fix For: pre-apache > > > This is a meta issue for tracking @atsikiridis progress with implementing a full Hadoop Compatibliltiy Layer for Stratosphere. > Some documentation can be found in the Wiki: https://github.com/stratosphere/stratosphere/wiki/%5BGSoC-14%5D-A-Hadoop-abstraction-layer-for-Stratosphere-(Project-Map-and-Notes) > As well as the project proposal: https://github.com/stratosphere/stratosphere/wiki/GSoC-2014-Project-Proposal-Draft-by-Artem-Tsikiridis > Most importantly, there is the following **schedule**: > *19 May - 27 June (Midterm)* > 1) Work on the Hadoop tasks, their Context and the mapping of Hadoop's Configuration to the one of Stratosphere. By successfully bridging the Hadoop tasks with Stratosphere, we already cover the most basic Hadoop Jobs. This can be determined by running some popular Hadoop examples on Stratosphere (e.g. WordCount, k-means, join) (4 - 5 weeks) > 2) Understand how the running of these jobs works (e.g. command line interface) for the wrapper. Implement how will the user run them. (1 - 2 weeks). > *27 June - 11 August* > 1) Continue wrapping more "advanced" Hadoop Interfaces (Comparators, Partitioners, Distributed Cache etc.) There are quite a few interfaces and it will be a challenge to support all of them. (5 full weeks) > 2) Profiling of the application and optimizations (if applicable) > *11 August - 18 August* > Write documentation on code, write a README with care and add more unit-tests. (1 week) > ---------------- Imported from GitHub ---------------- > Url: https://github.com/stratosphere/stratosphere/issues/838 > Created by: [rmetzger|https://github.com/rmetzger] > Labels: core, enhancement, parent-for-major-feature, > Milestone: Release 0.7 (unplanned) > Created at: Tue May 20 10:11:34 CEST 2014 > State: open -- This message was sent by Atlassian JIRA (v6.2#6252)