hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HADOOP-17293) refreshing S3Guard records after TTL-triggered-HEAD breaks some workflows
Date Mon, 05 Oct 2020 15:19:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-17293?focusedWorklogId=495392&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-495392

ASF GitHub Bot logged work on HADOOP-17293:

                Author: ASF GitHub Bot
            Created on: 05/Oct/20 15:18
            Start Date: 05/Oct/20 15:18
    Worklog Time Spent: 10m 
      Work Description: steveloughran opened a new pull request #2361:
URL: https://github.com/apache/hadoop/pull/2361

   This reverts changes in HADOOP-13230 to use S3Guard TTL in choosing when
   to issue a HEAD request; fixing tests to compensate.
   New operation cost constant, S3GUARD_NONAUTH_FILE_STATUS_PROBE for
   use in cost tests.
   Change-Id: Ie00279eb94f105d7fc99c7d3342eaf7002fef347
   testing in progress: S3 London + S3Guard + markers keep and delete

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:

Issue Time Tracking

            Worklog Id:     (was: 495392)
    Remaining Estimate: 0h
            Time Spent: 10m

> refreshing S3Guard records after TTL-triggered-HEAD breaks some workflows
> -------------------------------------------------------------------------
>                 Key: HADOOP-17293
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17293
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.3.1
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
> an incidental part of HDP-13230 was a fix to innerGetFileStatus, wherein after a HEAD
request we would update the DDB record, so resetting it's TTL
> Applications which did remote updates of buckets without going through s3guard are now
triggering failures in applications in the cluster when they go to open the file

This message was sent by Atlassian Jira

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message