Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AF2F610DF1 for ; Tue, 8 Sep 2015 19:35:10 +0000 (UTC) Received: (qmail 53664 invoked by uid 500); 8 Sep 2015 19:35:10 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 53577 invoked by uid 500); 8 Sep 2015 19:35:10 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 53566 invoked by uid 99); 8 Sep 2015 19:35:10 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Sep 2015 19:35:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 1518F180333 for ; Tue, 8 Sep 2015 19:35:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id u23PGUlxwHGH for ; Tue, 8 Sep 2015 19:35:01 +0000 (UTC) Received: from mail-yk0-f172.google.com (mail-yk0-f172.google.com [209.85.160.172]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 08FF1204DD for ; Tue, 8 Sep 2015 19:35:01 +0000 (UTC) Received: by ykcf206 with SMTP id f206so135594412ykc.3 for ; Tue, 08 Sep 2015 12:35:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=iypzAH1xao3/cIM0Wrk/O8+kP6UiB80AeNiVcGGKmUw=; b=rFECO8QQv82QGS9XebKl6uLMi+Z0CGQseXe+3k+pt5Qx4A51kYuA1NtwhOnL5z0JhY qjDV2XPOdtNDgrp2gHCq1Mfhr+0nIns9j6U+UKw6vq2744j1cGDUlqYtSCTkB5z7moWA 7Oe31eWPue6N+a03njszJO/w1n7VEiaHb4iGOHARj2VHYs5ODuZRkO5QHXnl3GtqRxzI aenGoK/zcG7XHB0qJmAafSy0sSGXl1pLAssda7BpZ36h9zq5sYQheJt8v/dCtx5KsiCG Ti4p1gSuHfVE5rlhVQYPPe99eUsy74DA3Zv3JR3Ew/bMQrx998IwV4bLjpn8M4OSdzxC ANEQ== MIME-Version: 1.0 X-Received: by 10.13.234.80 with SMTP id t77mr24019026ywe.89.1441740900030; Tue, 08 Sep 2015 12:35:00 -0700 (PDT) Sender: ewenstephan@gmail.com Received: by 10.31.128.19 with HTTP; Tue, 8 Sep 2015 12:34:59 -0700 (PDT) In-Reply-To: <05FE165B-B4D7-4661-9C7A-1986AB7EBFD0@data-artisans.com> References: <05FE165B-B4D7-4661-9C7A-1986AB7EBFD0@data-artisans.com> Date: Tue, 8 Sep 2015 21:34:59 +0200 X-Google-Sender-Auth: LnA6ficIMG1b_WGDsdodDuelBYM Message-ID: Subject: Re: HadoopDataOutputStream maybe does not expose enough methods of org.apache.hadoop.fs.FSDataOutputStream From: Stephan Ewen To: user@flink.apache.org Content-Type: multipart/alternative; boundary=94eb2c06a3943466b7051f4176c1 --94eb2c06a3943466b7051f4176c1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi! I pushed a fix to the master to expose more methods. You can access the original Hadoop stream now, and you can also call "flush()" and "sync()" in the Flink stream, which get forwarded as "hflush()" and "hsync()" in Hadoop 2 (in Hadoop 1 these are not available). The fix is in the master and I will make it part of the upcoming milestone release. Greetings, Stephan On Thu, Aug 27, 2015 at 9:51 AM, Ufuk Celebi wrote= : > > > On 27 Aug 2015, at 09:33, LINZ, Arnaud wrote= : > > > > Hi, > > > > Ok, I=E2=80=99ve created FLINK-2580 to track this issue (and FLINK-257= 9, which > is totally unrelated). > > Thanks :) > > > I think I=E2=80=99m going to set up my dev environment to start contrib= uting a > little more than just complaining J. > > If you need any help with the setup, let us know. There is also this > guide: > https://ci.apache.org/projects/flink/flink-docs-master/internals/ide_setu= p.html > > =E2=80=93 Ufuk > > --94eb2c06a3943466b7051f4176c1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi!

I pushed a fix to the master to exp= ose more methods.

You can access the original Hado= op stream now, and you can also call "flush()" and "sync()&q= uot; in the Flink stream, which get forwarded as "hflush()" and &= quot;hsync()" in Hadoop 2 (in Hadoop 1 these are not available).
=

The fix is in the master and I will make it part of the= upcoming milestone release.

Greetings,
Stephan=


On Thu, Aug 27, 2015 at 9:51 AM, Ufuk Celebi &l= t;ufuk@data-art= isans.com> wrote:

> On 27 Aug 2015, at 09:33, LINZ, Arnaud <ALINZ@bouyguestelecom.fr> wrote:
>
> Hi,
>
> Ok, I=E2=80=99ve created=C2=A0 FLINK-2580 to t= rack this issue (and FLINK-2579, which is totally unrelated).

Thanks :)

> I think I=E2=80=99m going to set up my dev environment to start contri= buting a little more than just complaining J.

If you need any help with the setup, let us know. There is also this= guide: https://ci.ap= ache.org/projects/flink/flink-docs-master/internals/ide_setup.html

=E2=80=93 Ufuk


--94eb2c06a3943466b7051f4176c1--