hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "HCFS/Progress" by JayVyas
Date Tue, 02 Sep 2014 11:39:23 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "HCFS/Progress" page has been changed by JayVyas:
https://wiki.apache.org/hadoop/HCFS/Progress?action=diff&rev1=21&rev2=22

- '''How to update the HCFS contract and test classes as the FileSystem evolves.'''
+ '''September 2, 2014 ''''''How to update the HCFS contract and test classes as the FileSystem
evolves.'''
  
  When we define new file system behaviours, its critical to update the contract documentation
and tests.  However, its not particularly difficult to do this,
  
@@ -16, +16 @@

  
  2) Update the existing unit tests (test/java/org/apache/hadoop/fs/contract/) where relevant.
  
- '''Hadoop FileSystem and FileContext work, largely concluded.'''
+ For an example of how to use the HCFS contract tests in a file system implementation, read
below.
  
+ ----
+ '''July 14, 2014 Hadoop FileSystem and FileContext work, largely concluded.'''
+ 
- Good news ! With https://issues.apache.org/jira/browse/HADOOP-9361, we are now able to test
hadoop FileSystems in an unambiguous and declarative manner, using a combination of:
+ With https://issues.apache.org/jira/browse/HADOOP-9361, we are now able to test hadoop FileSystems
in an unambiguous and declarative manner, using a combination of:
  
  * An XML File to define FileSystem semantics.  This file needs to be loaded in your unit
tests.  The contract will define the semantics of your file system, and the unit tests will
then test based on the parameters you define.  For example,
  
@@ -48, +51 @@

  
  Thanks to Steve Loughran and other 9361 reviewers for this critical and timely update to
the hadoop contract tests.  This democratizes storage underneath hadoop and enables continued
co-evolution of storage and YARN computation, hand in hand.
  
+ ----
  '''Hadoop FileSystem and FileContext Workstream (2014) '''
  
  In order to begin iterating on improving HCFS test coverage we need an unambiguous mechanism
for implementing HCFS tests.  After implementing HCFS tests, we want to compare test coverage
with a gold-standard, and finally, where any gaps exist we want to be able to justify them
using simplest semantics possible, ideally in code.  The below three JIRAs address these 3
issues.  Once they are completed, HCFS testing will be much simpler.

Mime
View raw message