Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 050FD10E53 for ; Tue, 5 May 2015 15:58:38 +0000 (UTC) Received: (qmail 66540 invoked by uid 500); 5 May 2015 15:58:32 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 66499 invoked by uid 500); 5 May 2015 15:58:32 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 66486 invoked by uid 99); 5 May 2015 15:58:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 May 2015 15:58:32 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=HTML_MESSAGE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: encountered temporary error during SPF processing of domain of dlmarion@comcast.net) Received: from [54.164.171.186] (HELO mx1-us-east.apache.org) (54.164.171.186) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 May 2015 15:58:24 +0000 Received: from resqmta-ch2-01v.sys.comcast.net (resqmta-ch2-01v.sys.comcast.net [69.252.207.33]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 9428842E76 for ; Tue, 5 May 2015 15:57:43 +0000 (UTC) Received: from resomta-ch2-05v.sys.comcast.net ([69.252.207.101]) by resqmta-ch2-01v.sys.comcast.net with comcast id QFwh1q0042Bo0NV01FxdNa; Tue, 05 May 2015 15:57:37 +0000 Received: from resmail-ch2-129v.sys.comcast.net ([162.150.48.163]) by resomta-ch2-05v.sys.comcast.net with comcast id QFxd1q0023XFKay01Fxd7o; Tue, 05 May 2015 15:57:37 +0000 Date: Tue, 5 May 2015 15:57:36 +0000 (UTC) From: dlmarion@comcast.net To: dev@accumulo.apache.org Message-ID: <1525679203.6280551.1430841456957.JavaMail.zimbra@comcast.net> In-Reply-To: <5548E707.6070308@gmail.com> References: <1430818553916-14005.post@n5.nabble.com> <1112106393.6192134.1430837292679.JavaMail.zimbra@comcast.net> <5548E407.9020305@gmail.com> <579542724.6264416.1430840642941.JavaMail.zimbra@comcast.net> <5548E707.6070308@gmail.com> Subject: Re: Ingest speed MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_6280550_1063674633.1430841456956" X-Originating-IP: [::ffff:63.239.65.11] X-Mailer: Zimbra 8.0.7_GA_6031 (ZimbraWebClient - FF31 (Win)/8.0.7_GA_6031) Thread-Topic: Ingest speed Thread-Index: 6txkRfOiw+zawrjVRPA0CK1cC1XOsQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1430841457; bh=GKC6/C6ds0kpSm7dx9TLE+BhEBM/yo8M9izccx6172E=; h=Received:Received:Date:From:To:Message-ID:Subject:MIME-Version: Content-Type; b=OWsiPLlUagswsOHCSLsCUkeFnO+icIZHJ/uANIU4JPsNdpflKKnokVkKTgyWpFaf3 ziJGSpJBFthc8qGvsaBt/Jj4l7m/QOEvAnNaPlle1ORdDXpVAioPtCDtFbHva9/tox 92c84ugLc7ryrS/vHS++zPwQ+VRCx+4SGpVkHzpaSJB0oid0e8gzGV6YwTqbFXUAIY MXPf/VMTkMGrZLL6pfO4BGU2mH2kd1RaHB9I+3BhJxoRO1z82WJ9biYs+dmj45n7qB Y1Et/LkBA5K5Cpof6WNplB5nqqUIUWgiYde10RQ42Skgqq38vmXPL0YzYQLhxJHzcw MaRjZumCHb1yQ== X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_6280550_1063674633.1430841456956 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Fair enough. Point taken. ----- Original Message ----- From: "Josh Elser" To: dev@accumulo.apache.org Sent: Tuesday, May 5, 2015 11:51:35 AM Subject: Re: Ingest speed Well, let this serve as a big "please" to write _something_. JIRA is not a form of documentation for users. It's a neat feature, but if there's no documentation about it, it's going to die. dlmarion@comcast.net wrote: > Only what is in the ticket. Not sure there is enough information to fill a chapter. > > ----- Original Message ----- > > From: "Josh Elser" > To: dev@accumulo.apache.org > Sent: Tuesday, May 5, 2015 11:38:47 AM > Subject: Re: Ingest speed > > Dave -- is there any documentation on this? Seems like it would be very > well served by a user-manual chapter. > > dlmarion@comcast.net wrote: >> Revan, >> >> You could use the scripting[1] feature in the shell for this purpose. The feature allows you to use JSR-223 compatible languages for your scripts. You will see javascript and python as examples in the comments on the JIRA ticket. >> >> [1] https://issues.apache.org/jira/browse/ACCUMULO-1399 >> >> ----- Original Message ----- >> >> From: "Revan1988" >> To: dev@accumulo.apache.org >> Sent: Tuesday, May 5, 2015 5:35:53 AM >> Subject: Ingest speed >> >> Hi, >> I'm an Italian student and i'm going to be graduated having thesis about >> using accumulo. >> I've developed a little java application that reads LOGS in a .json file and >> insert them into accumulo. >> In my virtual machine my app's insert/sec score is about 6'000. >> I see that there are some bench test that scores about 50'000 in my VM. >> (It's in $ACCUMULO_HOME/test/system/* folder.) >> Those test use the shell call to insert a large amount of data. >> So I think that i could write all my insert using an accumulo-shell call in >> my app. >> I've seen that i can execute that command: >> >> ./bin/accumulo shell -u username -p passw -e "insert row fam qual val [vis] >> [timestamp]" >> >> but there is a problem: i need to set up the table with the command table >> (infact insert command has not -t >> option). >> >> So there is any way to execute two commands in a row into accumulo shell? i >> tried with&& ; and other separator but with no success. >> >> The other option that i have is to write a big command file with all >> commands that i need and send it to accumulo shell using the command >> >> ./bin/accumulo shell -f >> >> it may be a better solution cause i'll connect to accumulo just one time >> (and not for every insert)... >> >> Any suggest? >> >> Thank you everybody and sorry for my bad english. >> >> Revan >> >> >> > > ------=_Part_6280550_1063674633.1430841456956--