manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shinichiro Abe (JIRA)" <>
Subject [jira] [Updated] (CONNECTORS-1006) Google native documents are not crawled
Date Wed, 27 Aug 2014 05:25:57 GMT


Shinichiro Abe updated CONNECTORS-1006:

    Attachment: CONNECTORS-1006.patch

Hi Shigeki,

Please apply this fixed patch and confirm this.

It seems that googleFile.getFileSize() always returns null when the file object is Google
Also, I changed export format from pdf to xlsx when document is Google Spreadsheet
so that we avoid cutting strings out of cell in pdf format.

> Google native documents are not crawled
> ---------------------------------------
>                 Key: CONNECTORS-1006
>                 URL:
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: GoogleDrive connector
>    Affects Versions: ManifoldCF 1.4.1
>            Reporter: Shigeki Kobayashi
>         Attachments: CONNECTORS-1006.patch
> I use MCF 1.4.1 and try to crawl google native documents such as spreadsheet then index
to solr.
> It seems that MCF would not extract the contents. Maybe MCF would not export  spreadsheet
to PDF.
> The Simple History tells the result of crawl is "NO LENGTH".
> The documents are saved as Google Spreadsheet in Google Docs, which are also managed
in Google Drive.
> As MCF documentation says "native Google documents such as spreadsheets and word documents
are exported to PDF and then ingested", those Google Spreadsheets should be crawled and indexed.

This message was sent by Atlassian JIRA

View raw message