hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. C. Srivas" <mcsri...@gmail.com>
Subject Re: Add getDatanodeReport function to libhdfs
Date Sun, 22 Apr 2012 00:09:03 GMT
hi Alexandre, see inline:

On Thu, Apr 19, 2012 at 12:56 PM, Alexandre Beche
<Alexandre.Beche@cern.ch>wrote:

> Hi everyone,
>
> We are currently working on a distributed file system and we are aiming to
> integrate hdfs to it.
> The libhdfs is quite complete for our use-case. However we miss a key
> function: a function that retrieves all datanodes of the cluster.
>
> We would like to submit a patch to add this function to the library. This
> patch could include a new data type (hdfsNamenode) with their associated
> method to instantiate and free it and the hdfsGetDatanodes.
>

Sounds good.  But the user should be aware that the list returned by
hdfsGetDatanodes() will be incomplete/inaccurate, as new nodes may come and
go at any time.


>
> An other idea: starting from the hdfsFS, can I write a function to
> retrieve the Namenode of that FS? (if yes, which function to use?
> getServerDefault)
>

With HA (or federation), there is no "the Namenode" .

What is the intent? I mean, how will the return value of this function be
used?




>
> Do you have any comment? Do you think this kind of patch could be accepted
> (if no why?)
>
> Thanks in advance,
> Cheers,
>
> Alexandre Beche
> CERN / IT-GT-DMS
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message