From droids-commits-return-189-apmail-incubator-droids-commits-archive=incubator.apache.org@incubator.apache.org Mon Nov 16 10:06:26 2009 Return-Path: Delivered-To: apmail-incubator-droids-commits-archive@minotaur.apache.org Received: (qmail 30050 invoked from network); 16 Nov 2009 10:06:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 16 Nov 2009 10:06:26 -0000 Received: (qmail 72456 invoked by uid 500); 16 Nov 2009 10:06:26 -0000 Delivered-To: apmail-incubator-droids-commits-archive@incubator.apache.org Received: (qmail 72427 invoked by uid 500); 16 Nov 2009 10:06:26 -0000 Mailing-List: contact droids-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: droids-dev@incubator.apache.org Delivered-To: mailing list droids-commits@incubator.apache.org Received: (qmail 72417 invoked by uid 99); 16 Nov 2009 10:06:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Nov 2009 10:06:25 +0000 X-ASF-Spam-Status: No, hits=-4.2 required=5.0 tests=AWL,BAYES_00 X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Nov 2009 10:06:05 +0000 Received: by eris.apache.org (Postfix, from userid 65534) id 97EB02388A8C; Mon, 16 Nov 2009 10:04:44 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r880695 [32/40] - in /incubator/droids/trunk: ./ docs/ docs/api/ docs/api/droids-core/ docs/api/droids-core/org/ docs/api/droids-core/org/apache/ docs/api/droids-core/org/apache/droids/ docs/api/droids-core/org/apache/droids/api/ docs/api/d... Date: Mon, 16 Nov 2009 10:03:49 -0000 To: droids-commits@incubator.apache.org From: thorsten@apache.org X-Mailer: svnmailer-1.0.8 Message-Id: <20091116100444.97EB02388A8C@eris.apache.org> Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotClient.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotClient.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotClient.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotClient.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,143 @@ + + + + + + + +Uses of Class org.apache.droids.norobots.NoRobotClient (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Uses of Class
org.apache.droids.norobots.NoRobotClient

+
+No usage of org.apache.droids.norobots.NoRobotClient +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotException.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotException.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotException.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/NoRobotException.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,174 @@ + + + + + + + +Uses of Class org.apache.droids.norobots.NoRobotException (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Uses of Class
org.apache.droids.norobots.NoRobotException

+
+ + + + + +
+Uses of NoRobotException in org.apache.droids.norobots
+  +

+ + + + + + + + + + + + + +
Methods in org.apache.droids.norobots that throw NoRobotException
+ voidNoRobotClient.parse(java.net.URI baseUri) + +
+          Head to a website and suck in their robots.txt file.
+ voidNoRobotClient.parseText(java.io.InputStream instream) + +
+           
+  +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/Rule.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/Rule.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/Rule.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/Rule.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,143 @@ + + + + + + + +Uses of Interface org.apache.droids.norobots.Rule (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Uses of Interface
org.apache.droids.norobots.Rule

+
+No usage of org.apache.droids.norobots.Rule +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/SimpleContentLoader.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/SimpleContentLoader.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/SimpleContentLoader.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/class-use/SimpleContentLoader.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,143 @@ + + + + + + + +Uses of Class org.apache.droids.norobots.SimpleContentLoader (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Uses of Class
org.apache.droids.norobots.SimpleContentLoader

+
+No usage of org.apache.droids.norobots.SimpleContentLoader +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-frame.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-frame.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-frame.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-frame.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,59 @@ + + + + + + + +org.apache.droids.norobots (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + +org.apache.droids.norobots + + + + +
+Interfaces  + +
+ContentLoader +
+Rule
+ + + + + + +
+Classes  + +
+NoRobotClient +
+SimpleContentLoader
+ + + + + + +
+Exceptions  + +
+NoRobotException
+ + + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-summary.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-summary.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-summary.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-summary.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,233 @@ + + + + + + + +org.apache.droids.norobots (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+

+Package org.apache.droids.norobots +

+Using norobots-rfc +

+See: +
+          Description +

+ + + + + + + + + + + + + +
+Interface Summary
ContentLoaderAn abstract loader intended for retrieving content identified by a URI.
RuleA robots.txt rule.
+  + +

+ + + + + + + + + + + + + +
+Class Summary
NoRobotClientA Client which may be used to decide which urls on a website + may be looked at, according to the norobots specification + located at: + http://www.robotstxt.org/wc/norobots-rfc.html
SimpleContentLoaderA simple implementation of ContentLoader based on URLConnection.
+  + +

+ + + + + + + + + +
+Exception Summary
NoRobotExceptionApplication exception for anything that might go wrong + in the checking of a robots.txt file.
+  + +

+

+Package org.apache.droids.norobots Description +

+ +

+

Using norobots-rfc

+
    +
  1. Import the class + + import org.apache.http.norobots.NoRobotClient; + +
  2. +
  3. Create an instance for your user-agent + + NoRobotClient nrc = NoRobotClient("googlebot"); + +
  4. +
  5. Parse a robots.txt at a site + + nrc.parse( new URL( "http://www.apache.org/" ) ); + +
  6. +
  7. Ask if a url is allowed + + boolean test = nrc.isUrlAllowed( new URL( "http://www.apache.org/index.html" ) ); + +
  8. +
+

+ +

+

+
+
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-tree.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-tree.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-tree.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-tree.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,160 @@ + + + + + + + +org.apache.droids.norobots Class Hierarchy (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Hierarchy For Package org.apache.droids.norobots +

+
+

+Class Hierarchy +

+ +

+Interface Hierarchy +

+ +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-use.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-use.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-use.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/org/apache/droids/norobots/package-use.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,163 @@ + + + + + + + +Uses of Package org.apache.droids.norobots (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Uses of Package
org.apache.droids.norobots

+
+ + + + + + + + + + + +
+Classes in org.apache.droids.norobots used by org.apache.droids.norobots
ContentLoader + +
+          An abstract loader intended for retrieving content identified by a URI.
NoRobotException + +
+          Application exception for anything that might go wrong + in the checking of a robots.txt file.
+  +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/overview-tree.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/overview-tree.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/overview-tree.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/overview-tree.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,162 @@ + + + + + + + +Class Hierarchy (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Hierarchy For All Packages

+
+
+
Package Hierarchies:
org.apache.droids.norobots
+
+

+Class Hierarchy +

+ +

+Interface Hierarchy +

+ +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/package-list URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/package-list?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/package-list (added) +++ incubator/droids/trunk/docs/api/droids-norobots/package-list Mon Nov 16 10:01:53 2009 @@ -0,0 +1 @@ +org.apache.droids.norobots Added: incubator/droids/trunk/docs/api/droids-norobots/resources/inherit.gif URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/resources/inherit.gif?rev=880695&view=auto ============================================================================== Binary file - no diff available. Propchange: incubator/droids/trunk/docs/api/droids-norobots/resources/inherit.gif ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: incubator/droids/trunk/docs/api/droids-norobots/serialized-form.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/serialized-form.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/serialized-form.html (added) +++ incubator/droids/trunk/docs/api/droids-norobots/serialized-form.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,165 @@ + + + + + + + +Serialized Form (Droids Norobots 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Serialized Form

+
+
+ + + + + +
+Package org.apache.droids.norobots
+ +

+ + + + + +
+Class org.apache.droids.norobots.NoRobotException extends java.lang.Exception implements Serializable
+ +

+serialVersionUID: 7185905140738392746L + +

+ +

+


+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-norobots/stylesheet.css URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-norobots/stylesheet.css?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-norobots/stylesheet.css (added) +++ incubator/droids/trunk/docs/api/droids-norobots/stylesheet.css Mon Nov 16 10:01:53 2009 @@ -0,0 +1,29 @@ +/* Javadoc style sheet */ + +/* Define colors, fonts and other style attributes here to override the defaults */ + +/* Page background color */ +body { background-color: #FFFFFF; color:#000000 } + +/* Headings */ +h1 { font-size: 145% } + +/* Table colors */ +.TableHeadingColor { background: #CCCCFF; color:#000000 } /* Dark mauve */ +.TableSubHeadingColor { background: #EEEEFF; color:#000000 } /* Light mauve */ +.TableRowColor { background: #FFFFFF; color:#000000 } /* White */ + +/* Font used in left-hand frame lists */ +.FrameTitleFont { font-size: 100%; font-family: Helvetica, Arial, sans-serif; color:#000000 } +.FrameHeadingFont { font-size: 90%; font-family: Helvetica, Arial, sans-serif; color:#000000 } +.FrameItemFont { font-size: 90%; font-family: Helvetica, Arial, sans-serif; color:#000000 } + +/* Navigation bar fonts and colors */ +.NavBarCell1 { background-color:#EEEEFF; color:#000000} /* Light mauve */ +.NavBarCell1Rev { background-color:#00008B; color:#FFFFFF} /* Dark Blue */ +.NavBarFont1 { font-family: Arial, Helvetica, sans-serif; color:#000000;color:#000000;} +.NavBarFont1Rev { font-family: Arial, Helvetica, sans-serif; color:#FFFFFF;color:#FFFFFF;} + +.NavBarCell2 { font-family: Arial, Helvetica, sans-serif; background-color:#FFFFFF; color:#000000} +.NavBarCell3 { font-family: Arial, Helvetica, sans-serif; background-color:#FFFFFF; color:#000000} + Added: incubator/droids/trunk/docs/api/droids-solr/allclasses-frame.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-solr/allclasses-frame.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-solr/allclasses-frame.html (added) +++ incubator/droids/trunk/docs/api/droids-solr/allclasses-frame.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,34 @@ + + + + + + + +All Classes (Droids Solr 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + +All Classes +
+ + + + + +
AdvancedSolrHandler +
+SolrHandler +
+
+ + + Added: incubator/droids/trunk/docs/api/droids-solr/allclasses-noframe.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-solr/allclasses-noframe.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-solr/allclasses-noframe.html (added) +++ incubator/droids/trunk/docs/api/droids-solr/allclasses-noframe.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,34 @@ + + + + + + + +All Classes (Droids Solr 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + +All Classes +
+ + + + + +
AdvancedSolrHandler +
+SolrHandler +
+
+ + + Added: incubator/droids/trunk/docs/api/droids-solr/constant-values.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-solr/constant-values.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-solr/constant-values.html (added) +++ incubator/droids/trunk/docs/api/droids-solr/constant-values.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,145 @@ + + + + + + + +Constant Field Values (Droids Solr 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Constant Field Values

+
+
+Contents
    +
+ +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + + Added: incubator/droids/trunk/docs/api/droids-solr/deprecated-list.html URL: http://svn.apache.org/viewvc/incubator/droids/trunk/docs/api/droids-solr/deprecated-list.html?rev=880695&view=auto ============================================================================== --- incubator/droids/trunk/docs/api/droids-solr/deprecated-list.html (added) +++ incubator/droids/trunk/docs/api/droids-solr/deprecated-list.html Mon Nov 16 10:01:53 2009 @@ -0,0 +1,145 @@ + + + + + + + +Deprecated List (Droids Solr 0.1-incubating-SNAPSHOT API) + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+
+

+Deprecated API

+
+
+Contents
    +
+ +
+ + + + + + + + + + + + + + + +
+ +
+ + + +
+Copyright © 2007-2009. All Rights Reserved. + +