hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Nauroth <cnaur...@hortonworks.com>
Subject Re: Anyone know how to mock a secured hdfs for unit test?
Date Fri, 27 Jun 2014 20:27:08 GMT
Hi David and Kai,

There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856.  That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works.  Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named

I hope this helps.

There are a few other open issues out there related to tests in secure
mode.  I know of HDFS-4312 and HDFS-5410.  It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.

Chris Nauroth

On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <kai.zheng@intel.com> wrote:

> Hi David,
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
> Regards,
> Kai
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
> Hi all,
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
> Thanks

NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message