incubator-any23-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Potter <...@yahoo-inc.com>
Subject Too many tuples!!
Date Fri, 30 Mar 2012 15:07:30 GMT
Hi,
  I'm trying to use Any23 to get statistics about embedded RDF use on the web.  I'm running
Any23 in Hadoop against millions of pages held in HDFS to get the stats.  Any23 handles most
pages as expected, but I've found a few where I don't understand the output.  I should point
out that I've only just learned about embedded RDF for this project, and only have a basic
understanding.  I was hoping someone could explain Any23's output with respect to one page
in particular :-

http://en.wikipedia.org/wiki/List_of_Nike_missile_locations

Any23 generates almost 3 million tuples for that one page.  Most of which are produced by
the 'consolidation-extractor'.

I would be grateful if someone could confirm what Any23 is doing is correct for this page
or/and explain how I can disable the 'consolidation-extractor' . It doesn't seem to be in
the list of extractors returned by
'./any23tools ExtractorDocumentation Clist'.   I've pasted a snippet of the HTML below with
the resulting tuples below that.

Thanks,
  Tim Potter.


Given the HTML Snippet:


<a href="http://toolserver.org/~geohack/geohack.php?pagename=List_of_Nike_missile_locations&amp;params=34_22_41_N_118_09_03_W_&amp;title=LA-04-LS"
class="external text" rel="nofollow" style="white-space: normal;">

<span class="geo-default">

<span title="Maps, aerial photos, and other data for this location" class="geo-dms">

<span class="latitude">342241N</span>

<span class="longitude">1180903W</span>

</span>

</span>

<span class="geo-multi-punct">&#65279; / &#65279;</span>

<span class="geo-nondefault">

<span class="vcard">

<span title="Maps, aerial photos, and other data for this location" class="geo-dec">34.37806N
118.15083W</span>

<span style="display: none">

&#65279; /

<span class="geo">34.37806; -118.15083</span>

</span>

<span style="display: none">

&#65279; (

<span class="fn org">LA-04-LS</span>

)

</span>

</span>

</span>

</a>


Any23 extracts:


_:node157214bb842b175461abdf44b5787dd <http://www.w3.org/1999/02/22-rdf-syntax-ns#type>
<http://www.w3.org/2006/vcard/ns#Location> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"html-mf-geo" .

_:node157214bb842b175461abdf44b5787dd <http://www.w3.org/2006/vcard/ns#latitude> "34.37806"
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-geo" .

_:node157214bb842b175461abdf44b5787dd <http://www.w3.org/2006/vcard/ns#longitude> "-118.15083"
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-geo" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://www.w3.org/2006/vcard/ns#fn> "LA-04-LS"
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://www.w3.org/2006/vcard/ns#n> _:node16phu9j7ux1
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:node16phu9j7ux1 <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://www.w3.org/2006/vcard/ns#Name>
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://www.w3.org/2006/vcard/ns#org> _:node16phu9j7ux2
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:node16phu9j7ux2 <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://www.w3.org/2006/vcard/ns#Organization>
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:node16phu9j7ux2 <http://www.w3.org/2006/vcard/ns#organization-name> "LA-04-LS" <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"html-mf-hcard" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://www.w3.org/2006/vcard/ns#geo> _:node157214bb842b175461abdf44b5787dd
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-mf-hcard" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://www.w3.org/1999/02/22-rdf-syntax-ns#type>
<http://www.w3.org/2006/vcard/ns#VCard> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"html-mf-hcard" .

<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> <http://en.wikipedia.org/wiki/List_of_Nike_missile_locationnofollow>
<http://toolserver.org/~geohack/geohack.php?pagename=List_of_Nike_missile_locations&params=34_22_41_N_118_09_03_W_&title=LA-04-LS>
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "html-rdfa11" .

_:node157214bb842b175461abdf44b5787dd <http://vocab.sindice.net/any23#domain> "en.wikipedia.org"
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:nodea43a444bf02e5a9978a17445654c8e0 <http://vocab.sindice.net/any23#domain> "en.wikipedia.org"
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:node18871329c2301faeb8b884f5c688cd16 <http://vocab.sindice.net/any23#nesting_original>
<http://www.w3.org/2006/vcard/ns#n> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node18871329c2301faeb8b884f5c688cd16 <http://vocab.sindice.net/any23#nesting_structured>
_:node16phu9j7ux1 <http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:nodea43a444bf02e5a9978a17445654c8e0 <http://vocab.sindice.net/any23#nesting> _:node18871329c2301faeb8b884f5c688cd16
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:node7372d6f01e9ccd65216edea5bf03a16 <http://vocab.sindice.net/any23#nesting_original>
<http://www.w3.org/2006/vcard/ns#org> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node7372d6f01e9ccd65216edea5bf03a16 <http://vocab.sindice.net/any23#nesting_structured>
_:node16phu9j7ux2 <http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:nodea43a444bf02e5a9978a17445654c8e0 <http://vocab.sindice.net/any23#nesting> _:node7372d6f01e9ccd65216edea5bf03a16
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:node9210ae8593cd2455c55128694d648235 <http://vocab.sindice.net/any23#nesting_original>
<http://www.w3.org/2006/vcard/ns#geo> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node9210ae8593cd2455c55128694d648235 <http://vocab.sindice.net/any23#nesting_structured>
_:node157214bb842b175461abdf44b5787dd <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:nodea43a444bf02e5a9978a17445654c8e0 <http://vocab.sindice.net/any23#nesting> _:node9210ae8593cd2455c55128694d648235
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:node8c1547411285c19d99213deef34a79d <http://vocab.sindice.net/any23#nesting_original>
<http://www.w3.org/2006/vcard/ns#latitude> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node8c1547411285c19d99213deef34a79d <http://vocab.sindice.net/any23#nesting_structured>
_:nodea43a444bf02e5a9978a17445654c8e0 <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node157214bb842b175461abdf44b5787dd <http://vocab.sindice.net/any23#nesting> _:node8c1547411285c19d99213deef34a79d
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.

_:node8b7c9512fab442b21a43a861506829 <http://vocab.sindice.net/any23#nesting_original>
<http://www.w3.org/2006/vcard/ns#longitude> <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node8b7c9512fab442b21a43a861506829 <http://vocab.sindice.net/any23#nesting_structured>
_:nodea43a444bf02e5a9978a17445654c8e0 <http://en.wikipedia.org/wiki/List_of_Nike_missile_location>
"consolidation-extractor" .

_:node157214bb842b175461abdf44b5787dd <http://vocab.sindice.net/any23#nesting> _:node8b7c9512fab442b21a43a861506829
<http://en.wikipedia.org/wiki/List_of_Nike_missile_location> "consolidation-extractor"
.


Mime
View raw message