hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HDDS-1511) Space tracking for Open Containers in HDDS Volumes
Date Wed, 15 May 2019 09:23:00 GMT

     [ https://issues.apache.org/jira/browse/HDDS-1511?focusedWorklogId=242367&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-242367

ASF GitHub Bot logged work on HDDS-1511:

                Author: ASF GitHub Bot
            Created on: 15/May/19 09:22
            Start Date: 15/May/19 09:22
    Worklog Time Spent: 10m 
      Work Description: supratimdeka commented on issue #812: HDDS-1511. Space tracking for
Open Containers in HDDS Volumes. Contributed by Supratim Deka
URL: https://github.com/apache/hadoop/pull/812#issuecomment-492577036
   TestBlockOutputStreamWithFailures appears to be unpredictable - failures are intermittent.
   TestHddsDatanodeService appears to be broken.
   both are failing on trunk without the patch. Filed a jira for this issue.
   remaining tests are passing locally.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 242367)
    Time Spent: 2h 40m  (was: 2.5h)

> Space tracking for Open Containers in HDDS Volumes
> --------------------------------------------------
>                 Key: HDDS-1511
>                 URL: https://issues.apache.org/jira/browse/HDDS-1511
>             Project: Hadoop Distributed Data Store
>          Issue Type: Improvement
>          Components: Ozone Datanode
>            Reporter: Supratim Deka
>            Assignee: Supratim Deka
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HDDS-1511.000.patch, HDDS-1511.001.patch
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
> For every HDDS Volume, track the space usage in open containers. Introduce a counter
committedBytes in HddsVolume - this counts the remaining space in Open containers until they
reach max capacity. The counter is incremented (by container max capacity) for every container
create. And decremented (by chunk size) for every chunk write.
> Space tracking for open containers will enable adding a safety check during container
> If there is not sufficient free space in the volume, the container create operation can
be failed.
> The scope of this jira is to just add the space tracking for Open Containers. Checking
for space and failing container create will be introduced in a subsequent jira.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message