Return-Path: 
 <commits-return-1809-apmail-community-commits-archive=community.apache.org@community.apache.org>
X-Original-To: apmail-community-commits-archive@minotaur.apache.org
Delivered-To: apmail-community-commits-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id AC6DF18AF4
	for <apmail-community-commits-archive@minotaur.apache.org>;
 Sat,  4 Jul 2015 09:22:43 +0000 (UTC)
Received: (qmail 71928 invoked by uid 500); 4 Jul 2015 09:22:43 -0000
Delivered-To: apmail-community-commits-archive@community.apache.org
Received: (qmail 71903 invoked by uid 500); 4 Jul 2015 09:22:43 -0000
Mailing-List: contact commits-help@community.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:commits-help@community.apache.org>
List-Unsubscribe: <mailto:commits-unsubscribe@community.apache.org>
List-Post: <mailto:commits@community.apache.org>
List-Id: <commits.community.apache.org>
Reply-To: dev@community.apache.org
Delivered-To: mailing list commits@community.apache.org
Received: (qmail 71891 invoked by uid 99); 4 Jul 2015 09:22:43 -0000
Received: from eris.apache.org (HELO hades.apache.org) (140.211.11.105)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jul 2015 09:22:43 +0000
Received: from hades.apache.org (localhost [127.0.0.1])
	by hades.apache.org (ASF Mail Server at hades.apache.org) with ESMTP id
 76B66AC0155
	for <commits@community.apache.org>; Sat,  4 Jul 2015 09:22:43 +0000 (UTC)
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Subject: svn commit: r1689127 -
 /comdev/projects.apache.org/scripts/import/parseprojects.py
Date: Sat, 04 Jul 2015 09:22:43 -0000
To: commits@community.apache.org
From: hboutemy@apache.org
X-Mailer: svnmailer-1.0.9
Message-Id: <20150704092243.76B66AC0155@hades.apache.org>

Author: hboutemy
Date: Sat Jul  4 09:22:43 2015
New Revision: 1689127

URL: http://svn.apache.org/r1689127
Log:
when parse errors found, parse only rdf in error

Modified:
    comdev/projects.apache.org/scripts/import/parseprojects.py

Modified: comdev/projects.apache.org/scripts/import/parseprojects.py
URL: http://svn.apache.org/viewvc/comdev/projects.apache.org/scripts/import/parseprojects.py?rev=1689127&r1=1689126&r2=1689127&view=diff
==============================================================================
--- comdev/projects.apache.org/scripts/import/parseprojects.py (original)
+++ comdev/projects.apache.org/scripts/import/parseprojects.py Sat Jul  4 09:22:43 2015
@@ -5,7 +5,12 @@ import json
 import os
 import traceback
 
-with open("../../data/projects.xml", "r") as f:
+projectsList = "../../data/projects.xml";
+save = True;
+if os.path.exists("parseprojects-failures.xml"):
+    projectsList = "parseprojects-failures.xml";
+    save = False;
+with open(projectsList, "r") as f:
     data  = f.read()
     f.close()
 xmldoc = minidom.parseString(data)
@@ -141,13 +146,14 @@ for s in itemlist :
             f.write(rdf)
             f.close()
 
-print("Writing foundation/projects.json...")
-with open ("../../site/json/foundation/projects.json", "w") as f:
-    f.write(json.dumps(projects, sort_keys=True, indent=0))
-    f.close()
+if save:
+    print("Writing foundation/projects.json...")
+    with open ("../../site/json/foundation/projects.json", "w") as f:
+        f.write(json.dumps(projects, sort_keys=True, indent=0))
+        f.close()
 
 if len(failures) > 0:
-    with open ("rdfparse-failures.xml", "w") as f:
+    with open ("parseprojects-failures.xml", "w") as f:
         f.write("<doapFiles>\n")
         for fail in failures:
             f.write("<location>%s</location>\n" % fail)