hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Prakash <ravi...@ymail.com>
Subject Re: Unit tests on Hadoop Cluster
Date Mon, 05 Jan 2015 16:22:31 GMT
Hi Kamal!
Thanks for your initiative. Please take a look at MiniDFSCluster / MiniJournalCluster / MiniYarnCluster
etc. In your unit tests you can essentially start a cluster in a single JVM. You can look
at TestQJMWithFaults.java

     On Sunday, January 4, 2015 10:09 PM, kamaldeep singh <kamaldeep.ebay@gmail.com>

 Hi , 
I'm a beginner to writing unit tests in hadoop. 

As per https://wiki.apache.org/hadoop/HowToDevelopUnitTests the Hadoop Unit tests are all
designed to work on a local machine, rather than a full-scale Hadoop cluster.
However  i do see the Hadoop-QA https://issues.apache.org/jira/secure/ViewProfile.jspa?name=hadoopqa also
runs unit test cases when it validates a patch for any issue like https://issues.apache.org/jira/browse/YARN-2459?focusedCommentId=14115586&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14115586
So does this mean it runs unit tests only in single node / local setup for validating any
patches ?
I wish to write some unit tests in a HA env thus i need test in a cluster setup 

View raw message