hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jestin Joy <jestin...@gmail.com>
Subject Processing large file from HDFS
Date Mon, 16 Jun 2014 05:36:25 GMT
Unlike many users here, I started using Hadoop with Hama. I have a large
file for graph processing (Close to 1GB). What should be the best way to
read that file from HDFS? Read the whole data to RAM? The file is arranged
as

1 2
1 4
1 5
....

Where first column denotes a vertex and second column denotes adjacent
vertex to that vertex.  What is the idea of processing a large file from
HDFS?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message