hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikas Ashok Patil <vikas...@buffalo.edu>
Subject Integrating Lustre and HDFS
Date Thu, 10 Jun 2010 09:37:33 GMT
Hello All,

I would like to try out a hadoop configuration involving both lustre and
hdfs. Hence I would like to know any thoughts/criticisms on the idea.

In my cluster I have the lustre parallel file system which mainly exposes
storage over a network. Also there is some local space on each node of the
cluster. This space is not part of the lustre file system. My hadoop
installation currently makes use of this local file system. However, I would
like to make use of the space available through lustre(exposed over the
network). Hence I was thinking of a way to integrate HDFS and lustre, where
HDFS would manage the local storage and lustre would provide the storage
over the network.

Please let me know your thoughts on this.

Thanks,
Vikas A Patil

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message