From common-issues-return-205322-apmail-hadoop-common-issues-archive=hadoop.apache.org@hadoop.apache.org Tue Sep 8 14:02:04 2020 Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@locus.apache.org Delivered-To: apmail-hadoop-common-issues-archive@locus.apache.org Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by minotaur.apache.org (Postfix) with ESMTP id 85BCB1A235 for ; Tue, 8 Sep 2020 14:02:04 +0000 (UTC) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id 3461F122CDC for ; Tue, 8 Sep 2020 14:02:04 +0000 (UTC) Received: (qmail 51372 invoked by uid 500); 8 Sep 2020 14:02:03 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 51318 invoked by uid 500); 8 Sep 2020 14:02:03 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 51205 invoked by uid 99); 8 Sep 2020 14:02:03 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Sep 2020 14:02:03 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 82A5041E6C for ; Tue, 8 Sep 2020 14:02:02 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 760D07804B2 for ; Tue, 8 Sep 2020 14:02:00 +0000 (UTC) Date: Tue, 8 Sep 2020 14:02:00 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=480152&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480152 ] ASF GitHub Bot logged work on HADOOP-17242: ------------------------------------------- Author: ASF GitHub Bot Created on: 08/Sep/20 14:01 Start Date: 08/Sep/20 14:01 Worklog Time Spent: 10m Work Description: steveloughran commented on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-688895798 on this again. Need to think about what happens after hasNext raises an exception. IMO we should cache it and rethrow on all subsequent hasNext/next. Without that if you catch an IOE and call hasNext again it may get confused (maybe, I'd need to experiment) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 480152) Time Spent: 1h 10m (was: 1h) > S3A (async) ObjectListingIterator to block in hasNext() for results > ------------------------------------------------------------------- > > Key: HADOOP-17242 > URL: https://issues.apache.org/jira/browse/HADOOP-17242 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 3.4.0 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Minor > Labels: pull-request-available > Time Spent: 1h 10m > Remaining Estimate: 0h > > HADOOP-17074 made listing async in S3A, but the iterator's hasNext Call doesn't wait for the result. If invoked on an empty path it *may* return when it should be failing. > Note: surfaced in code review, not seen in the wild and all our tests were happy -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org