hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Swapnil Daingade (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11044) FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps
Date Tue, 16 Sep 2014 00:32:34 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134750#comment-14134750
] 

Swapnil Daingade commented on HADOOP-11044:
-------------------------------------------

Sorry for the delay and thanks for the help Gary. Will fix and update patch.

> [WARNING] /root/ossgit2/hadoop-common/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FCStatisticsBaseTest.java:[72,34]
[deprecation] getWriteOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FCStatisticsBaseTest.java:[77,32]
[deprecation] getWriteOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FCStatisticsBaseTest.java:[81,35]
[deprecation] getWriteOps() in Statistics has been deprecated
230a237,242
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[407,49]
[deprecation] getReadOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[410,50]
[deprecation] getWriteOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[413,54]
[deprecation] getLargeReadOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[514,55]
[deprecation] getReadOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[515,56]
[deprecation] getWriteOps() in Statistics has been deprecated
> [WARNING] /root/ossgit2/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java:[516,60]
[deprecation] getLargeReadOps() in Statistics has been deprecated

> FileSystem counters can overflow for large number of readOps, largeReadOps, writeOps
> ------------------------------------------------------------------------------------
>
>                 Key: HADOOP-11044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11044
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 2.5.0, 2.4.1
>            Reporter: Swapnil Daingade
>            Priority: Minor
>         Attachments: 11044.patch4, 11044.patch4
>
>
> The org.apache.hadoop.fs.FileSystem.Statistics.StatisticsData class defines readOps,
largeReadOps, writeOps as int. Also the The org.apache.hadoop.fs.FileSystem.Statistics class
has methods like getReadOps(), getLargeReadOps() and getWriteOps() that return int. These
int values can overflow if the exceed 2^31-1 showing negative values. It would be nice if
these can be changed to long.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message