hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Miles Osborne" <mi...@inf.ed.ac.uk>
Subject Re: What's the best way to get to a single key?
Date Mon, 03 Mar 2008 22:32:10 GMT
It should be possible to use the hash of a key to work-out which shard it is
present in;  you would then search over all entries in the relevant shard.


On 03/03/2008, Xavier Stevens <Xavier.Stevens@fox.com> wrote:
> I am curious how others might be solving this problem.  I want to
> retrieve a record from HDFS based on its key.  Are there any methods
> that can shortcut this type of search to avoid parsing all data until
> you find it?  Obviously Hbase would do this as well, but I wanted to
> know if there is a way to do it using just Map/Reduce and HDFS.
> Thanks,
> -Xavier

The University of Edinburgh is a charitable body, registered in Scotland,
with registration number SC005336.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message