Mailing-List: contact allura-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: allura-dev@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of noreply@sourceforge.net
 designates 216.34.181.60 as permitted sender)
Content-Type: multipart/related;
 boundary="===============1952355484245964624=="
MIME-Version: 1.0
To: "[allura:tickets] " <6464@tickets.allura.p.re.sf.net>
From: "Cory Johns" <masterbunnyfu@users.sf.net>
Reply-To: "[allura:tickets] " <6464@tickets.allura.p.re.sf.net>
Subject: [allura:tickets] #6464 Create tracker importer for Google Code using
 CSV and
 scraping
Message-ID: 
 </p/allura/tickets/6464/25097e9b44d8ed2a17d9ca03d54d13c2365cee27.tickets@allura.p.sourceforge.net>
Date: Wed, 07 Aug 2013 14:45:51 +0000

--===============1952355484245964624==
Content-Type: multipart/alternative;
 boundary="===============4164732310210162157=="
MIME-Version: 1.0

--===============4164732310210162157==
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit

- **status**: open --> code-review


---

** [tickets:#6464] Create tracker importer for Google Code using CSV and scraping**

**Status:** code-review
**Labels:** import google-code 
**Created:** Mon Jul 15, 2013 05:21 PM UTC by Cory Johns
**Last Updated:** Mon Jul 29, 2013 12:23 AM UTC
**Owner:** Cory Johns

Since the Google Data API for Issues is deprecated and was scheduled to be shut down already (June 14th, 2013), we'll need to create an implementation using the CSV list and scraping to ensure that the Google Code importer continues to work.

The importer should follow the framework discussed on the [mailing list](http://mail-archives.apache.org/mod_mbox/incubator-allura-dev/201307.mbox/%3CCAEMb8zUg7Kem2aDxVzAqF3U4aKEj7jL3UO=UpX=2+NfY_P8kXQ@mail.gmail.com%3E) and integrate with the project importer from [#6456].

        The list of tickets and their metadata can be retrieved via the CSV export list, e.g., https://code.google.com/p/modwsgi/issues/csv but the ticket body and comments will need to be scraped from the web interface.  The description and comments can be retrieved from, e.g., https://code.google.com/p/modwsgi/issues/detail?id=22 by iterating over the items with `id="hc\d+"` or `class="issuedescription|issuecomment"`.

The description and comments on issues don't support wiki syntax or HTML, so we can just convert them to text.  User mapping will have the same issues, so whatever we end up doing in [#6461] will apply here.


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.
--===============4164732310210162157==
MIME-Version: 1.0
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: 7bit

<div class="markdown_content"><ul>
<li><strong>status</strong>: open --&gt; code-review</li>
</ul>
<hr />
<p><strong> <a class="alink" href="http://sourceforge.net/p/allura/tickets/6464/">[tickets:#6464]</a> Create tracker importer for Google Code using CSV and scraping</strong></p>
<p><strong>Status:</strong> code-review<br />
<strong>Labels:</strong> import google-code <br />
<strong>Created:</strong> Mon Jul 15, 2013 05:21 PM UTC by Cory Johns<br />
<strong>Last Updated:</strong> Mon Jul 29, 2013 12:23 AM UTC<br />
<strong>Owner:</strong> Cory Johns</p>
<p>Since the Google Data API for Issues is deprecated and was scheduled to be shut down already (June 14th, 2013), we'll need to create an implementation using the CSV list and scraping to ensure that the Google Code importer continues to work.</p>
<p>The importer should follow the framework discussed on the <a class="" href="http://mail-archives.apache.org/mod_mbox/incubator-allura-dev/201307.mbox/%3CCAEMb8zUg7Kem2aDxVzAqF3U4aKEj7jL3UO=UpX=2+NfY_P8kXQ@mail.gmail.com%3E" rel="nofollow">mailing list</a> and integrate with the project importer from <a class="alink" href="http://sourceforge.net/p/allura/tickets/6456/">[#6456]</a>.</p>
<div class="codehilite"><pre>    <span class="n">The</span> <span class="n">list</span> <span class="n">of</span> <span class="n">tickets</span> <span class="n">and</span> <span class="n">their</span> <span class="n">metadata</span> <span class="n">can</span> <span class="n">be</span> <span class="n">retrieved</span> <span class="n">via</span> <span class="n">the</span> <span class="n">CSV</span> <span class="n">export</span> <span class="n">list</span><span class="p">,</span> <span class="n">e</span><span class="p">.</span><span class="n">g</span><span class="p">.,</span> <span class="n">https</span><span class="o">:</span><span class="c1">//code.google.com/p/modwsgi/issues/csv but the ticket body and comments will need to be scraped from the web interface.  The description and comments can be retrieved from, e.g., https://code.google.com/p/modwsgi/issues/detail?id=22 by iterating over the items with `id=&quot;hc\d+&quot;` or `class=&quot;issuedescription|issuecomment&quot;`.</span>
</pre></div>
<p>The description and comments on issues don't support wiki syntax or HTML, so we can just convert them to text.  User mapping will have the same issues, so whatever we end up doing in <a class="alink" href="http://sourceforge.net/p/allura/tickets/6461/">[#6461]</a> will apply here.</p>
<hr />
<p>Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to <a href="https://sourceforge.net/p/allura/tickets/">https://sourceforge.net/p/allura/tickets/</a></p>
<p>To unsubscribe from further messages, a project admin can change settings at <a href="https://sourceforge.net/p/allura/admin/tickets/options.">https://sourceforge.net/p/allura/admin/tickets/options.</a>  Or, if this is a mailing list, you can unsubscribe from the mailing list.</p></div>
--===============4164732310210162157==--

--===============1952355484245964624==--