lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Grant Ingersoll (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-2728) EnwikiContentSource does not properly identify the name/id of the Wikipedia article
Date Thu, 28 Oct 2010 19:12:19 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925916#action_12925916
] 

Grant Ingersoll commented on LUCENE-2728:
-----------------------------------------

Yes.  I'm trying at the moment, but my IntelliJ setup is screwed up which makes it harder
to merge

> EnwikiContentSource does not properly identify the name/id of the Wikipedia article
> -----------------------------------------------------------------------------------
>
>                 Key: LUCENE-2728
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2728
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/benchmark
>            Reporter: Grant Ingersoll
>            Assignee: Grant Ingersoll
>            Priority: Minor
>             Fix For: 3.1, 4.0
>
>         Attachments: LUCENE-2728.patch
>
>
> The EnwikiContentSource does not properly identify the id (name in benchmark parlance)
of the documents.  It currently produces assigns the id on the last <id> tag it sees
in the document, as opposed to the id of the document.  Most documents have multiple <id>
tags in them.  This prevents the ContentSource from being used effectively in producing documents
for updating.
> Example doc:
> {quote}
> <page>
>     <title>AlgeriA</title>
>     <id>5</id>
>     <revision>
>       <id>133452200</id>
>       <timestamp>2007-05-25T17:11:48Z</timestamp>
>       <contributor>
>         <username>Gurch</username>
>         <id>241822</id>
>       </contributor>
>       <minor />
>       <comment>[[WP:AES|รข<86><90>]]Redirected page to [[Algeria]]</comment>
>       <text xml:space="preserve">#REDIRECT [[Algeria]] {{R from CamelCase}}</text>
>     </revision>
>   </page>
> {quote}
> In this case, the getName() return 241822 instead of 5.  page/id is unique according
to the schema at  http://www.mediawiki.org/xml/export-0.3.xsd, so we should just get that
one.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message