hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruba Borthakur <dhr...@gmail.com>
Subject Re: File access pattern on HDFS?
Date Tue, 08 Mar 2011 04:53:11 GMT
sure, one option (maybe not a very scalable one) is to register a URL with
the namenode. The NN can then post a batch of transactions as a POST to the
specified URL.

another option would be to write the file-change-log to a well-known hdfs
file itself.

thanks
dhruba


On Mon, Mar 7, 2011 at 1:05 PM, Gautam Singaraju <gautam.singaraju@gmail.com
> wrote:

> HDFS-1179: is exactly what I was looking for. Would it be a good idea to
> transmit info over TCP/UDP?
> ---
> Gautam
>
>
>
> On Mon, Mar 7, 2011 at 11:46 AM, Dhruba Borthakur <dhruba@gmail.com>wrote:
>
>> Here is a JIRA that talks about a file-change-log (but no work has been
>> done
>> yet)
>>
>> http://issues.apache.org/jira/browse/HDFS-1179
>>
>> thanks,
>> dhruba
>>
>> On Mon, Mar 7, 2011 at 1:24 AM, Harsh J <qwertymaniac@gmail.com> wrote:
>>
>> > There is no such information (history of atime changes, although atime
>> > is held for every file in the NN) held by the NameNode right now. I
>> > think HDFS-782 is slightly relevant to maintaining a 'hot-zone' info,
>> > although at a block level and among datanodes. I couldn't find a jira
>> > that talks about keeping a list of atime modifications on the
>> > NameNode.
>> >
>> > On Mon, Mar 7, 2011 at 4:00 AM, Gautam Singaraju
>> > <gautam.singaraju@gmail.com> wrote:
>> > > Hi,
>> > >
>> > > Is there a mechanism to get the list of files accessed on HDFS at the
>> > > NameNode?
>> > > Thanks!
>> > > ---
>> > > Gautam
>> > >
>> >
>> >
>> >
>> > --
>> > Harsh J
>> > www.harshj.com
>> >
>>
>>
>>
>> --
>> Connect to me at http://www.facebook.com/dhruba
>>
>
>


-- 
Connect to me at http://www.facebook.com/dhruba

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message