Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@accumulo.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CANdYuYO5n9chU=9Y03LKGBW6s+Kfqfj=JXdf9DEeG-u+eUg2+w@mail.gmail.com>
References: 
 <CANdYuYO5n9chU=9Y03LKGBW6s+Kfqfj=JXdf9DEeG-u+eUg2+w@mail.gmail.com>
Date: Fri, 8 Apr 2016 17:30:23 +0700
Message-ID: 
 <CANdYuYMvoSwhEeziOB7DbRzY2rZS89OZ7y3Q_MEpBNh_=_upnQ@mail.gmail.com>
Subject: Fwd: Data authorization/visibility limit in Accumulo
From: Fikri Akbar <fikri.akbar@ci-mediatrac.com>
To: dev@accumulo.apache.org
Content-Type: multipart/alternative; boundary=001a114123d2c1b753052ff6aeaa

--001a114123d2c1b753052ff6aeaa
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Guys,

We're a group of accumulo enthusiasts from Indonesia. We've been trying to
implement accumulo for several different type of data processing purposes.
We've got several questions regarding Accumulo, which you might help us
with. We encounter these issues when we're trying to process heavy amount
of data, our questions are as follows:

1. Let's say that I have a file in HDFS that's about 300 GB with a total
1.6 Billion rows, and each line are separated by "^". The question is, what
is the most effective way to move the data to Accumulo (with assumption
that the structure of each cell is [rowkey cf:cq vis value] =3D> [lineNumbe=
r
raw:columnName fileName columnValue])?

2. What is the most effective way to ingest data, if we're receiving data
with the size of >1 TB on a daily basis?

3. We're currently testing the ability of Accumulo for its data-level
access control, however the issue regarding the limit of dataset
authorization occurred when the datasets reached >20,000.

For example, lets say user X has a data called one.txt. This will make user
X has authorization to one.txt (let's call it X.one.txt). Now, what if X
has more than that (one.txt, two.xt, three.txt...n.txt), this will result
in user X having multiple authorization (as much as the data or n
authorization) and apparently when we tried it for datasets >20,000 (which
user will have >20,000 authorization), we're not able to execute "get
auth". We find that this is a very crucial issue, especially if (in one
case) there's >20,000 datasets that is being granted authorization at once.

The following are error logs from our system.

*Error log in shell:*

org.apache.accumulo.core.client.AccumuloException:
org.apache.thrift.TApplicationException: Internal error processing
getUserAuthorizations
        at
org.apache.accumulo.core.client.impl.SecurityOperationsImpl.execute(Securit=
yOperationsImpl.java:83)
        at
org.apache.accumulo.core.client.impl.SecurityOperationsImpl.getUserAuthoriz=
ations(SecurityOperationsImpl.java:182)
        at com.msk.auxilium.table.AuxUser.setUserAuth(AuxUser.java:310)
        at
com.msk.auxilium.commons.UserSystem.getAuxUser(UserSystem.java:24)
        at com.msk.auxilium.tester.HDFSTest.main(HDFSTest.java:57)
Caused by: org.apache.thrift.TApplicationException: Internal error
processing getUserAuthorizations
        at
org.apache.thrift.TApplicationException.read(TApplicationException.java:108=
)
        at
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
        at
org.apache.accumulo.core.client.impl.thrift.ClientService$Client.recv_getUs=
erAuthorizations(ClientService.java:580)
        at
org.apache.accumulo.core.client.impl.thrift.ClientService$Client.getUserAut=
horizations(ClientService.java:565)
        at
org.apache.accumulo.core.client.impl.SecurityOperationsImpl$6.execute(Secur=
ityOperationsImpl.java:185)
        at
org.apache.accumulo.core.client.impl.SecurityOperationsImpl$6.execute(Secur=
ityOperationsImpl.java:182)
        at
org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.j=
ava:90)
        at
org.apache.accumulo.core.client.impl.SecurityOperationsImpl.execute(Securit=
yOperationsImpl.java:69)
        ... 4 more

*Error log in accumulo master (web)*
tserver:

Zookeeper error, will retry
	org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode =3D ConnectionLoss for
/accumulo/281c3ac0-74eb-4135-bc63-3158eabe2c47/tables/1a/conf/table.split.t=
hreshold
		at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
		at org.apache.accumulo.fate.zookeeper.ZooCache$2.run(ZooCache.java:210)
		at org.apache.accumulo.fate.zookeeper.ZooCache.retry(ZooCache.java:132)
		at org.apache.accumulo.fate.zookeeper.ZooCache.get(ZooCache.java:235)
		at org.apache.accumulo.fate.zookeeper.ZooCache.get(ZooCache.java:190)
		at org.apache.accumulo.server.conf.TableConfiguration.get(TableConfigurat=
ion.java:130)
		at org.apache.accumulo.server.conf.TableConfiguration.get(TableConfigurat=
ion.java:118)
		at org.apache.accumulo.core.conf.AccumuloConfiguration.getMemoryInBytes(A=
ccumuloConfiguration.java:100)
		at org.apache.accumulo.tserver.Tablet.findSplitRow(Tablet.java:2892)
		at org.apache.accumulo.tserver.Tablet.needsSplit(Tablet.java:3032)
		at org.apache.accumulo.tserver.TabletServer$MajorCompactor.run(TabletServ=
er.java:2603)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java=
:34)
		at java.lang.Thread.run(Thread.java:745)

*garbage collector:*

Zookeeper error, will retry
	org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode =3D ConnectionLoss for
/accumulo/281c3ac0-74eb-4135-bc63-3158eabe2c47/tables
		at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
		at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
		at org.apache.accumulo.fate.zookeeper.ZooCache$1.run(ZooCache.java:169)
		at org.apache.accumulo.fate.zookeeper.ZooCache.retry(ZooCache.java:132)
		at org.apache.accumulo.fate.zookeeper.ZooCache.getChildren(ZooCache.java:=
180)
		at org.apache.accumulo.core.client.impl.Tables.getMap(Tables.java:126)
		at org.apache.accumulo.core.client.impl.Tables.getNameToIdMap(Tables.java=
:197)
		at org.apache.accumulo.core.client.impl.Tables._getTableId(Tables.java:17=
3)
		at org.apache.accumulo.core.client.impl.Tables.getTableId(Tables.java:166=
)
		at org.apache.accumulo.core.client.impl.ConnectorImpl.getTableId(Connecto=
rImpl.java:84)
		at org.apache.accumulo.core.client.impl.ConnectorImpl.createScanner(Conne=
ctorImpl.java:151)
		at org.apache.accumulo.gc.SimpleGarbageCollector$GCEnv.getCandidates(Simp=
leGarbageCollector.java:278)
		at org.apache.accumulo.gc.GarbageCollectionAlgorithm.getCandidates(Garbag=
eCollectionAlgorithm.java:238)
		at org.apache.accumulo.gc.GarbageCollectionAlgorithm.collect(GarbageColle=
ctionAlgorithm.java:272)
		at org.apache.accumulo.gc.SimpleGarbageCollector.run(SimpleGarbageCollect=
or.java:544)
		at org.apache.accumulo.gc.SimpleGarbageCollector.main(SimpleGarbageCollec=
tor.java:154)
		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j=
ava:57)
		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess=
orImpl.java:43)
		at java.lang.reflect.Method.invoke(Method.java:606)
		at org.apache.accumulo.start.Main$1.run(Main.java:141)
		at java.lang.Thread.run(Thread.java:745)


we tried finding some resources regarding this issue, but couldn't find any
that mention the limit of authorizations per user and FYI we're using
accumulo version 1.6.

Sorry for the long email :) and have a great day.

Regards,

*Fikri Akbar*
Technology


*PT Mediatrac Sistem Komunikasi*
Grha Tirtadi 2nd Floor   |   Jl. Senopati 71-73   |   Jakarta 12110   |
Indonesia   |   *M**ap* 6=C2=B013'57.37"S 106=C2=B048'42.29"E
*P* +62 21 520 2568   |   *F* +62 21 520 4180   |   *M*  +62 812 1243 4786
   |   *www.mediatrac.co.id <http://www.mediatrac.co.id>*

--001a114123d2c1b753052ff6aeaa--