Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@accumulo.apache.org
Received-SPF: pass (athena.apache.org: message received from 54.191.145.13
 which is an MX secondary for dev@accumulo.apache.org)
Date: Tue, 5 May 2015 14:48:12 +0000 (UTC)
From: dlmarion@comcast.net
To: dev@accumulo.apache.org
Message-ID: <1112106393.6192134.1430837292679.JavaMail.zimbra@comcast.net>
In-Reply-To: <1430818553916-14005.post@n5.nabble.com>
References: <1430818553916-14005.post@n5.nabble.com>
Subject: Re: Ingest speed
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_6192133_76310068.1430837292678"
Thread-Topic: Ingest speed
Thread-Index: 9CIgASk0+I8yxSgTytQ2fh6WFhjkfQ==

------=_Part_6192133_76310068.1430837292678
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Revan, 

You could use the scripting[1] feature in the shell for this purpose. The feature allows you to use JSR-223 compatible languages for your scripts. You will see javascript and python as examples in the comments on the JIRA ticket. 

[1] https://issues.apache.org/jira/browse/ACCUMULO-1399 

----- Original Message -----

From: "Revan1988" <andrealeoni88@gmail.com> 
To: dev@accumulo.apache.org 
Sent: Tuesday, May 5, 2015 5:35:53 AM 
Subject: Ingest speed 

Hi, 
I'm an Italian student and i'm going to be graduated having thesis about 
using accumulo. 
I've developed a little java application that reads LOGS in a .json file and 
insert them into accumulo. 
In my virtual machine my app's insert/sec score is about 6'000. 
I see that there are some bench test that scores about 50'000 in my VM. 
(It's in $ACCUMULO_HOME/test/system/* folder.) 
Those test use the shell call to insert a large amount of data. 
So I think that i could write all my insert using an accumulo-shell call in 
my app. 
I've seen that i can execute that command: 

./bin/accumulo shell -u username -p passw -e "insert row fam qual val [vis] 
[timestamp]" 

but there is a problem: i need to set up the table with the command table 
(infact insert command has not -t 
option). 

So there is any way to execute two commands in a row into accumulo shell? i 
tried with && ; and other separator but with no success. 

The other option that i have is to write a big command file with all 
commands that i need and send it to accumulo shell using the command 

./bin/accumulo shell -f <file> 

it may be a better solution cause i'll connect to accumulo just one time 
(and not for every insert)... 

Any suggest? 

Thank you everybody and sorry for my bad english. 

Revan 


-- 
View this message in context: http://apache-accumulo.1065345.n5.nabble.com/Ingest-speed-tp14005.html 
Sent from the Developers mailing list archive at Nabble.com. 


------=_Part_6192133_76310068.1430837292678--