commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roger Whitcomb <Roger.Whitc...@actian.com>
Subject RE: [VFS] Could the HDFS connector work with MapR systems?
Date Tue, 26 May 2015 23:32:27 GMT
So, I'm pretty sure (now) that it DOESN'T work.  There are comments here:  http://answers.mapr.com/questions/9224/apache-hadoop-client-connecting-to-namenode.html
and here:  http://doc.mapr.com/display/MapR/Accessing+MapR-FS+in+Java+Applications plus the
connector here:  https://github.com/pentaho/pentaho-hdfs-vfs 
that all point to special MapR code being needed, and the standard HDFS client protocols not
working.  Plus all my testing seemed to confirm this.

We have figured out a workaround for our configuration, though (we're basically requiring
an NFS mount of the MapR file system, so we can just browse the MapR files as native).

Thanks,
~Roger

-----Original Message-----
From: Gary Gregory [mailto:garydgregory@gmail.com] 
Sent: Tuesday, May 26, 2015 3:48 PM
To: Commons Users List
Subject: RE: [VFS] Could the HDFS connector work with MapR systems?

I've not seen VFS used in this configuration before. You could try updating to the current
HDFS jar files.
Gary 

-------- Original message --------
From: Roger Whitcomb <Roger.Whitcomb@actian.com> 
Date: 05/26/2015  10:39  (GMT-08:00) 
To: Commons Users List <user@commons.apache.org> 
Subject: [VFS] Could the HDFS connector work with MapR systems? 

Hi all,
                I'm using Commons VFS 2.1 along with the HDFS connector and
everything is working brilliantly ... until, that is, trying to access HDFS on a MapR system. 
Then I get things like null host name exceptions and the like.  So, anyone have any idea
whether the HDFS connector even COULD work against MapR?  And if not, anyone tried to build
a MapR connector to Commons VFS 2.1?

Thanks in advance,
~Roger Whitcomb
Mime
View raw message