asterixdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <ted.dunn...@gmail.com>
Subject Re: inotify in HDFS for external indexing?
Date Tue, 16 Jun 2015 02:05:07 GMT
Note that audit streams are often used for this as well.  These are
available for HDFS and MapR FS (at least).

Also, for MapR DB at least, you can get full changed-data-records as a call
back into your code even remote from the table.



On Mon, Jun 15, 2015 at 5:40 PM, Mike Carey <dtabass@gmail.com> wrote:

> Ooooohhhh.....  Cool!
> On Jun 15, 2015 5:31 PM, "Ian Maxon" <imaxon@uci.edu> wrote:
>
> > Stumbled across this new feature in HDFS:
> > https://issues.apache.org/jira/browse/HDFS-6634. Has anyone else seen
> > this? Basically it would let you be notified whenever files are
> > changed in HDFS, similar (but not exactly like) inotify. This sounds
> > like it could let us update externally indexed data on HDFS
> > incrementally doesn't it?...
> >
> > Just a random thought.
> >
> > -Ian
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message