From issues-return-157004-archive-asf-public=cust-asf.ponee.io@flink.apache.org Tue Mar 6 10:27:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id A8EE9180652 for ; Tue, 6 Mar 2018 10:27:04 +0100 (CET) Received: (qmail 35404 invoked by uid 500); 6 Mar 2018 09:27:03 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 35395 invoked by uid 99); 6 Mar 2018 09:27:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Mar 2018 09:27:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 52FE2C012E for ; Tue, 6 Mar 2018 09:27:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.511 X-Spam-Level: X-Spam-Status: No, score=-109.511 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Bj6qppP9pFaP for ; Tue, 6 Mar 2018 09:27:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id F0F215F169 for ; Tue, 6 Mar 2018 09:27:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 3FEF4E00A7 for ; Tue, 6 Mar 2018 09:27:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id C71CB2126D for ; Tue, 6 Mar 2018 09:27:00 +0000 (UTC) Date: Tue, 6 Mar 2018 09:27:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-8818) Harden YarnFileStageTest upload test for eventual consistent read-after-write MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FLINK-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387511#comment-16387511 ] ASF GitHub Bot commented on FLINK-8818: --------------------------------------- Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5601 Different FS implementations try to circumvent the problem (or not), e.g. Presto's implementation implements the retries itself whenever it cannot find an object, while Hadoop's implementation did not (may depend on the version and may be subject to change). Also I don't know what the guarantees say about someone else reading your write - that would be the actual real usecase: artefact uploading by the client, downloading the artefacts via yarn on the worker nodes. > Harden YarnFileStageTest upload test for eventual consistent read-after-write > ----------------------------------------------------------------------------- > > Key: FLINK-8818 > URL: https://issues.apache.org/jira/browse/FLINK-8818 > Project: Flink > Issue Type: Sub-task > Components: FileSystem, Tests, YARN > Affects Versions: 1.5.0 > Reporter: Nico Kruber > Assignee: Nico Kruber > Priority: Blocker > Fix For: 1.5.0, 1.4.3 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)