Return-Path: X-Original-To: apmail-lucene-general-archive@www.apache.org Delivered-To: apmail-lucene-general-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A286C7C77 for ; Fri, 2 Sep 2011 14:21:14 +0000 (UTC) Received: (qmail 93640 invoked by uid 500); 2 Sep 2011 14:21:14 -0000 Delivered-To: apmail-lucene-general-archive@lucene.apache.org Received: (qmail 93519 invoked by uid 500); 2 Sep 2011 14:21:12 -0000 Mailing-List: contact general-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@lucene.apache.org Delivered-To: mailing list general@lucene.apache.org Received: (qmail 93511 invoked by uid 99); 2 Sep 2011 14:21:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Sep 2011 14:21:12 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL,URI_HEX,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mtnest46@gmail.com designates 209.85.210.46 as permitted sender) Received: from [209.85.210.46] (HELO mail-pz0-f46.google.com) (209.85.210.46) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Sep 2011 14:21:06 +0000 Received: by pzk32 with SMTP id 32so5017504pzk.19 for ; Fri, 02 Sep 2011 07:20:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=quTkKzTyvZpZKXOGYYBQwF3zyt6n6hWIE2YP2qS2DWk=; b=e/6e5es4vYcyQE4xpk8ykZfKaSgFPxSByoxHtaJRk6SPm6t+YCg/PFDtc+nuY3c1K4 mdzESwZtA663PokOFoTuVKKAYkr1zK4O+WZfMSZnF85mL6SHyjc7gplppe5SLqh2meHP Yh7X3jUgn10gebKwItSUM8f5qWir8eiZi1rL8= MIME-Version: 1.0 Received: by 10.68.64.193 with SMTP id q1mr1582109pbs.237.1314973244761; Fri, 02 Sep 2011 07:20:44 -0700 (PDT) Received: by 10.142.142.8 with HTTP; Fri, 2 Sep 2011 07:20:44 -0700 (PDT) In-Reply-To: <1314913401150-3302667.post@n3.nabble.com> References: <1314913401150-3302667.post@n3.nabble.com> Date: Fri, 2 Sep 2011 10:20:44 -0400 Message-ID: Subject: Re: indexing 30million records to Solr using solrj doen't work but works for small files From: simon To: general@lucene.apache.org Content-Type: multipart/alternative; boundary=bcaec54308c424a7c404abf611d5 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec54308c424a7c404abf611d5 Content-Type: text/plain; charset=ISO-8859-1 You'd be better off submitting this question to the solr-users mailing list - that's where the Solr experts hang out. -Simon On Thu, Sep 1, 2011 at 5:43 PM, angel wrote: > Hi below is my java program for indexing around 30million records from > csv.But this doen't work for such a large file.It works perfectly fro > smaller files.What's the wrong with my code.please let me know > > try{ > /*SolrServer server = new > CommonsHttpSolrServer("http://localhost:8070/solr"); > > > //Start by deleting everything > > ContentStreamUpdateRequest req = new > ContentStreamUpdateRequest("/update/csv"); > > req.addFile(new File("/samplefile_25millionrecords.csv")); > req.setParam("commit", "true"); > req.setParam("stream.contentType", > "text/plain;charset=utf-8"); > req.setParam("separator", "|"); > req.setParam("skipLines", "0"); > //req.setParam("fieldnames","ewyyewu,etuiewtu");//30 or more > fielsd > > > NamedList result = server.request(req); > > > System.out.println("Result====================================================================================: > \n" + result); > > }catch(IOException e){ > e.printStackTrace(); > } catch (SolrServerException e) { > // TODO Auto-generated catch block > e.printStackTrace(); > }*/ > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/indexing-30million-records-to-Solr-using-solrj-doen-t-work-but-works-for-small-files-tp3302667p3302667.html > Sent from the Lucene - General mailing list archive at Nabble.com. > --bcaec54308c424a7c404abf611d5--