ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Veselovsky (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-3877) Clarify if IgfsFile -> FileStatus conversion should treat groupBlockSize as blockSize
Date Fri, 09 Sep 2016 14:58:20 GMT
Ivan Veselovsky created IGNITE-3877:
---------------------------------------

             Summary: Clarify if IgfsFile -> FileStatus conversion should treat groupBlockSize
as blockSize
                 Key: IGNITE-3877
                 URL: https://issues.apache.org/jira/browse/IGNITE-3877
             Project: Ignite
          Issue Type: Bug
          Components: IGFS
    Affects Versions: 1.6
            Reporter: Ivan Veselovsky
            Assignee: Ivan Veselovsky
             Fix For: 1.8


During Metrics tests repairing test org.apache.ignite.igfs.Hadoop1DualAbstractTest#testMetricsBlock
revealed the following problem:
org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem#convert(org.apache.ignite.igfs.IgfsFile)
method treats groupBlockSize as blockSize for Hadoop FileStatus. groupBlockSize can be several
times larger than blockSize, so blockSize in status gets different to that in original IgfsFile
.

changing file.groupBlockSize() to file.blockSize()  fixes problem in metrics tests, but creates
problems in Hadoop tests that are bound to splits calculation, since split calculation related
to blockSizes.

Ned to 
1) clarify if the treatment of groupBlcokSize was intentional.
2) fix either metrics tests or Hadoop tests. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message