Apache Tashi - Documentation

"rpyc (Remote Python Call) is a transparent and symmetrical python library for remote procedure calls, clustering and distributed-computing. RPyC makes use of object-proxying, a technique that employs python's dynamic nature, to overcome the physical boundaries between processes and computers, so that remote objects can be manipulated as if they were local."

-Thrift is a software framework for scalable cross-language services development. It combines a software stack with a code generation engine to build services that work efficiently and seamlessly between C++, Java, Python, PHP, Ruby, Erlang, Perl, Haskell, C#, Cocoa, Smalltalk, and OCaml. -

Disclaimer

+ Apache Tashi is an effort undergoing incubation at The Apache Software +Foundation (ASF), sponsored by the Apache Incubator PMC. +Incubation is required of all newly accepted projects until a further +review indicates that the infrastructure, communications, and decision +making process have stabilized in a manner consistent with other +successful ASF projects. While incubation status is not necessarily a +reflection of the completeness or stability of the code, it does +indicate that the project has yet to be fully endorsed by the ASF. +

Installation

Please note that the code distribution contains an installation walkthrough, which is more up to date than this document.

 svn co http://svn.apache.org/repos/asf/incubator/tashi/trunk ./tashi
@@ -130,7 +131,7 @@ Done
 
                                                                                                 If you haven't installed Tashi in /usr/lib/python2.5/site-packages/ or the equivalent folder, you must set the PYTHONPATH environment variable so that python can find the Tashi code:
                                                                                                 -mryan3@firsthost:~/scratch/tashi$ export PYTHONPATH=`pwd`/src
+mryan3@firsthost:~/scratch/tashi$ export PYTHONPATH=/usr/local/tashi/src
 
                                                                                                 Start the cluster manager (CM) first:
                                                                                                 @@ -154,6 +155,7 @@ In [3]: data.baseDataObject.save()
 
 In [4]:
 
+                                                                                                The name "default" for the network here is significant; automatic placement will only take place to the network called "default".
                                                                                                 If you were using MySQL (or sqlite), you'd have to populate the
 relevant tables in the database.
                                                                                                 @@ -191,6 +193,7 @@ mryan3@firsthost:~/scratch/tashi$ ./bin/
 
 
                                                                                                 VM deployment (XEN)
+                                                                                                Most Tashi users and developers currently use the Qemu interface, so the Xen interface may be more buggy. Please report any problems observed.
                                                                                                 Have your networking environment set up, so that the virtual machines
 may be attached to the proper virtual bridges.
                                                                                                 In Xen 3, virtual disks are attached using blktap, so make sure that

Modified: incubator/tashi/site/docs/documentation.html
URL: http://svn.apache.org/viewvc/incubator/tashi/site/docs/documentation.html?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/docs/documentation.html (original)
+++ incubator/tashi/site/docs/documentation.html Sun Mar  4 05:22:54 2012
@@ -114,6 +114,9 @@ table.options td {
 The primitive scheduler
 
                                                                                                 
+The accounting service
+
+                                                                                                
 Configuration options for Tashi
 
                                                                             

Modified: incubator/tashi/site/docs/faq.html
URL: http://svn.apache.org/viewvc/incubator/tashi/site/docs/faq.html?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/docs/faq.html (original)
+++ incubator/tashi/site/docs/faq.html Sun Mar  4 05:22:54 2012
@@ -99,15 +99,13 @@ table.options td {
                                 
                                     FAQ
                                                                         
-Q: Why does Tashi complain about "unexpected keyword argument 'd'"?
-

-A: Tashi was originally developed against an older version of Thrift.  This is mentioned on the documentation page.  You will have to downgrade to an older version of Thrift.
-
-                                                                                                
 Q: Why does Tashi have the error message "Failed to exec gmetric, disabling"
 

 A: This happens because Tashi was unable to find gmetric on your system.  gmetric is a part of Ganglia.  It is not necessary to use Ganglia in order to use Tashi, but Tashi has the ability to output per-VM statistics and log messages a Ganglia metrics.  If you don't care about either of those features, you can safely ignore this message -- or turn of the use of the GangliaPublisher class in the config file.
 
+                                                                                                
+Please submit additional candidates via the issue tracking system
+
                                                                             
                 
             

Modified: incubator/tashi/site/docs/road_map.html
URL: http://svn.apache.org/viewvc/incubator/tashi/site/docs/road_map.html?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/docs/road_map.html (original)
+++ incubator/tashi/site/docs/road_map.html Sun Mar  4 05:22:54 2012
@@ -103,7 +103,7 @@ table.options td {
 
 Demonstrate the ability to run HDFS on a set of hosts and the Hadoop JobTrackers in virtual machines while maintaining data-local performance: Done at CMU in 2010.
 Integrate with Zoni: Done by Richard Gass
-Have at least a rudimentary resource log to permit billing: Michael Stroucken
+Have at least a rudimentary resource log to permit billing: Done by Michael Stroucken
 
 
                                                                                                 Current issues

Modified: incubator/tashi/site/docs/source_code.html
URL: http://svn.apache.org/viewvc/incubator/tashi/site/docs/source_code.html?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/docs/source_code.html (original)
+++ incubator/tashi/site/docs/source_code.html Sun Mar  4 05:22:54 2012
@@ -107,6 +107,9 @@ Or from a command prompt:
 svn co http://svn.apache.org/repos/asf/incubator/tashi

+By Apache Incubator policy, the tags directory hold branches that were used to generate releases (or release candidates). The branches directory hold general purpose tracking and development branches. The "stable" branch tracks stability and security fixes from the trunk, but excludes new features or protocols. The "oldstable" branch tracks the branch previously held to be the stable branch. Only in rare instances will this branch be updated. +

ViewVC

If you're looking to browse it, you can use ViewVC at: http://svn.apache.org/repos/asf/incubator/tashi Modified: incubator/tashi/site/xdocs/dependencies.xml URL: http://svn.apache.org/viewvc/incubator/tashi/site/xdocs/dependencies.xml?rev=1296746&r1=1296745&r2=1296746&view=diff ============================================================================== --- incubator/tashi/site/xdocs/dependencies.xml (original) +++ incubator/tashi/site/xdocs/dependencies.xml Sun Mar 4 05:22:54 2012 @@ -33,14 +33,10 @@

+Certain Tashi modules may require additional interfaces and system libraries be installed. +

Please note that the code distribution contains an installation walkthrough, which is more up to date than this document.

 svn co http://svn.apache.org/repos/asf/incubator/tashi/trunk ./tashi
@@ -63,7 +65,7 @@ Done
 
 If you haven't installed Tashi in /usr/lib/python2.5/site-packages/ or the equivalent folder, you must set the PYTHONPATH environment variable so that python can find the Tashi code:
 -mryan3@firsthost:~/scratch/tashi$ export PYTHONPATH=`pwd`/src
+mryan3@firsthost:~/scratch/tashi$ export PYTHONPATH=/usr/local/tashi/src
 
 Start the cluster manager (CM) first:
 @@ -87,6 +89,8 @@ In [3]: data.baseDataObject.save()
 
 In [4]:
 
+The name "default" for the network here is significant; automatic placement will only take place to the network called "default".
+
 If you were using MySQL (or sqlite), you'd have to populate the
 relevant tables in the database.
 @@ -126,6 +130,8 @@ mryan3@firsthost:~/scratch/tashi$ ./bin/
 
 VM deployment (XEN)
 
+Most Tashi users and developers currently use the Qemu interface, so the Xen interface may be more buggy. Please report any problems observed.
+
 Have your networking environment set up, so that the virtual machines
 may be attached to the proper virtual bridges.
 

Modified: incubator/tashi/site/xdocs/documentation.xml
URL: http://svn.apache.org/viewvc/incubator/tashi/site/xdocs/documentation.xml?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/xdocs/documentation.xml (original)
+++ incubator/tashi/site/xdocs/documentation.xml Sun Mar  4 05:22:54 2012
@@ -44,6 +44,9 @@
 The primitive scheduler
 
 
+The accounting service
+
+
 Configuration options for Tashi
 
 

Modified: incubator/tashi/site/xdocs/faq.xml
URL: http://svn.apache.org/viewvc/incubator/tashi/site/xdocs/faq.xml?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/xdocs/faq.xml (original)
+++ incubator/tashi/site/xdocs/faq.xml Sun Mar  4 05:22:54 2012
@@ -29,17 +29,14 @@
 
 
 
-Q: Why does Tashi complain about "unexpected keyword argument 'd'"?
-

-A: Tashi was originally developed against an older version of Thrift.  This is mentioned on the documentation page.  You will have to downgrade to an older version of Thrift.
-
-
-
 Q: Why does Tashi have the error message "Failed to exec gmetric, disabling"
 

 A: This happens because Tashi was unable to find gmetric on your system.  gmetric is a part of Ganglia.  It is not necessary to use Ganglia in order to use Tashi, but Tashi has the ability to output per-VM statistics and log messages a Ganglia metrics.  If you don't care about either of those features, you can safely ignore this message -- or turn of the use of the GangliaPublisher class in the config file.
 
 
+
+Please submit additional candidates via the issue tracking system
+
 
 
 

Modified: incubator/tashi/site/xdocs/road_map.xml
URL: http://svn.apache.org/viewvc/incubator/tashi/site/xdocs/road_map.xml?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/xdocs/road_map.xml (original)
+++ incubator/tashi/site/xdocs/road_map.xml Sun Mar  4 05:22:54 2012
@@ -34,7 +34,7 @@
 
 Demonstrate the ability to run HDFS on a set of hosts and the Hadoop JobTrackers in virtual machines while maintaining data-local performance: Done at CMU in 2010.
 Integrate with Zoni: Done by Richard Gass
-Have at least a rudimentary resource log to permit billing: Michael Stroucken
+Have at least a rudimentary resource log to permit billing: Done by Michael Stroucken
 
 
 

Modified: incubator/tashi/site/xdocs/source_code.xml
URL: http://svn.apache.org/viewvc/incubator/tashi/site/xdocs/source_code.xml?rev=1296746&r1=1296745&r2=1296746&view=diff
==============================================================================
--- incubator/tashi/site/xdocs/source_code.xml (original)
+++ incubator/tashi/site/xdocs/source_code.xml Sun Mar  4 05:22:54 2012
@@ -36,6 +36,9 @@ Or from a command prompt:
 svn co http://svn.apache.org/repos/asf/incubator/tashi
 
 
+
+By Apache Incubator policy, the tags directory hold branches that were used to generate releases (or release candidates). The branches directory hold general purpose tracking and development branches. The "stable" branch tracks stability and security fixes from the trunk, but excludes new features or protocols. The "oldstable" branch tracks the branch previously held to be the stable branch. Only in rare instances will this branch be updated.
+

The accounting service of Tashi

Disclaimer

Installation

VM deployment (XEN)

FAQ

Current issues

ViewVC

VM deployment (XEN)