hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Trivial Update of "HCFS" by SteveWatt
Date Wed, 24 Apr 2013 04:50:59 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "HCFS" page has been changed by SteveWatt:
http://wiki.apache.org/hadoop/HCFS?action=diff&rev1=1&rev2=2

  
  ''How is this done?''
  
- Begin with the Abstract FileSystem explanation (todo). Point to [[https://issues.apache.org/jira/browse/HADOOP-9371|
Defining the Semantics of the Hadoop FileSystem more rigorously]]. Mention the work unwiring
Ambari from being exclusively HDFS. [[https://issues.apache.org/jira/browse/HADOOP-9258| Better
testing for HCFS]]
+ Hadoop FileSystem operations are implemented via a FileSystem plugin that extends the abstract
org.apache.hadoop.fs.FileSystem Class. The Hadoop Distributed File System (HDFS) is the most
prolific of these and extends the abstract FileSystem class with the org.apache.hadoop.hdfs.DistributedFileSystem
plugin. HDFS is however somewhat different to what you get with most plugins, in that it provides
not only the source code and implementation for the plugin, but for the entire FileSystem
itself. 
+ 
+ In some cases, the semantics of the Hadoop FileSystem operations can be ambiguous. The community
is presently attempting to [[https://issues.apache.org/jira/browse/HADOOP-9371| define the
Semantics of the Hadoop FileSystem more rigorously]] as well as adding [[https://issues.apache.org/jira/browse/HADOOP-9258|
better test coverage for Hadoop Compatible File Systems]]
+ 
+ In addition, work is being done by members of the community to support Hadoop Compatible
FileSystems within the [[http://incubator.apache.org/ambari/| Ambari project to deploy, configure
and manage Hadoop ]]
  
  ''What are some examples? ''
+ 
+ LocalFileSystem, S3FileSystem and KosmosFileSystem which are all available under src/core/org/apache/hadoop/fs/
+ 
+ [[http://www.datastax.com/dev/blog/cassandra-file-system-design | CassandraFS]]
  
  [[http://www.symantec.com/enterprise-solution-for-hadoop | Symtantec Veritas Cluster File
System]]
  
@@ -16, +24 @@

  
  [[https://issues.apache.org/jira/browse/HADOOP-8545| The Hadoop FileSystem Implementation
for OpenStack Swift]]
  
+ [[ http://answers.mapr.com/questions/116/is-mapr-wire-compatible-or-api-compatible-with-hadoop-0202
| MapR FileSystem]]
+ 

Mime
View raw message