accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Miller (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ACCUMULO-4486) Compaction from Shell hangs on Unknown property
Date Wed, 05 Oct 2016 17:35:20 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-4486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Michael Miller updated ACCUMULO-4486:
-------------------------------------
    Description: 
I was following the sampling [example|https://accumulo.apache.org/1.8/examples/sample] when
I mistyped one of the table properties. After realizing this I entered the correct property
but didn't remove the bad one. I then ran the "compact" command but the shell hung indefinitely.
There was an IllegalArgumentException printed in the log but I believe the bug is how the
shell mishandled the exception, never returning control to the user. Eventually I did get
a warning on the shell "WARN : Thread "shell" stuck on IO.." but never regained control of
the shell. Here are the commands run:
{code}
createtable sampex
insert 9255 doc content 'abcde'
insert 9255 doc url file://foo.txt
insert 8934 doc content 'accumulo scales'
insert 8934 doc url file://accumulo_notes.txt
insert 2317 doc content 'milk, eggs, bread, parmigiano-reggiano'
insert 2317 doc url file://groceries/9.txt
insert 3900 doc content 'EC2 ate my homework'
insert 3900 doc uril file://final_project.txt
config -t sampex -s table.sampler=org.apache.accumulo.core.client.sample.RowSampler
config -t sampex -s table.sampler.opt.haser=murmur3_32
config -t sampex -s table.sampler.opt.hasher=murmur3_32
config -t sampex -s table.sampler.opt.modulus=3
compact -t sampex --sf-no-sample
{code}

Stacktrace of the exception printed in the tserver log:
{code}
2016-10-05 13:13:25,299 [tablet.Compactor] ERROR: Unknown option : haser
java.lang.IllegalArgumentException: Unknown option : haser
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
        at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
        at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
        at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
        at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
        at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
        at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
        at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
        at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
        at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at java.lang.Thread.run(Thread.java:745)
2016-10-05 13:13:25,299 [tablet.MinorCompactor] WARN : MinC failed (Unknown option : haser)
to create hdfs://localhost:10000/accumulo/tables/2/default_tablet/F0000000.rf_tmp retrying
...
java.lang.IllegalArgumentException: Unknown option : haser
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
        at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
        at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
        at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
        at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
        at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
        at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
        at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
        at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
        at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at java.lang.Thread.run(Thread.java:745)

{code}




  was:
I was following the sampling [example|https://accumulo.apache.org/1.8/examples/sample] when
I mistyped one of the table properties. After realizing this I entered the correct property
but didn't remove the bad one. I then ran the "compact" command but the shell hung indefinitely.
There was an IllegalArgumentException printed in the log but I believe the bug is how the
shell mishandled the exception, never returning control to the user. Eventually I did get
a warning on the shell "WARN : Thread "shell" stuck on IO.." but never regained control of
the shell. Here are the commands run:
createtable sampex
insert 9255 doc content 'abcde'
insert 9255 doc url file://foo.txt
insert 8934 doc content 'accumulo scales'
insert 8934 doc url file://accumulo_notes.txt
insert 2317 doc content 'milk, eggs, bread, parmigiano-reggiano'
insert 2317 doc url file://groceries/9.txt
insert 3900 doc content 'EC2 ate my homework'
insert 3900 doc uril file://final_project.txt
config -t sampex -s table.sampler=org.apache.accumulo.core.client.sample.RowSampler
config -t sampex -s table.sampler.opt.haser=murmur3_32
config -t sampex -s table.sampler.opt.hasher=murmur3_32
config -t sampex -s table.sampler.opt.modulus=3
compact -t sampex --sf-no-sample

Stacktrace of the exception printed in the tserver log:
{code}
2016-10-05 13:13:25,299 [tablet.Compactor] ERROR: Unknown option : haser
java.lang.IllegalArgumentException: Unknown option : haser
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
        at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
        at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
        at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
        at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
        at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
        at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
        at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
        at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
        at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at java.lang.Thread.run(Thread.java:745)
2016-10-05 13:13:25,299 [tablet.MinorCompactor] WARN : MinC failed (Unknown option : haser)
to create hdfs://localhost:10000/accumulo/tables/2/default_tablet/F0000000.rf_tmp retrying
...
java.lang.IllegalArgumentException: Unknown option : haser
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
        at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
        at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
        at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
        at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
        at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
        at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
        at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
        at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
        at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
        at java.lang.Thread.run(Thread.java:745)

{code}





> Compaction from Shell hangs on Unknown property
> -----------------------------------------------
>
>                 Key: ACCUMULO-4486
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-4486
>             Project: Accumulo
>          Issue Type: Bug
>          Components: shell, tserver
>    Affects Versions: 1.8.0
>            Reporter: Michael Miller
>            Priority: Minor
>
> I was following the sampling [example|https://accumulo.apache.org/1.8/examples/sample]
when I mistyped one of the table properties. After realizing this I entered the correct property
but didn't remove the bad one. I then ran the "compact" command but the shell hung indefinitely.
There was an IllegalArgumentException printed in the log but I believe the bug is how the
shell mishandled the exception, never returning control to the user. Eventually I did get
a warning on the shell "WARN : Thread "shell" stuck on IO.." but never regained control of
the shell. Here are the commands run:
> {code}
> createtable sampex
> insert 9255 doc content 'abcde'
> insert 9255 doc url file://foo.txt
> insert 8934 doc content 'accumulo scales'
> insert 8934 doc url file://accumulo_notes.txt
> insert 2317 doc content 'milk, eggs, bread, parmigiano-reggiano'
> insert 2317 doc url file://groceries/9.txt
> insert 3900 doc content 'EC2 ate my homework'
> insert 3900 doc uril file://final_project.txt
> config -t sampex -s table.sampler=org.apache.accumulo.core.client.sample.RowSampler
> config -t sampex -s table.sampler.opt.haser=murmur3_32
> config -t sampex -s table.sampler.opt.hasher=murmur3_32
> config -t sampex -s table.sampler.opt.modulus=3
> compact -t sampex --sf-no-sample
> {code}
> Stacktrace of the exception printed in the tserver log:
> {code}
> 2016-10-05 13:13:25,299 [tablet.Compactor] ERROR: Unknown option : haser
> java.lang.IllegalArgumentException: Unknown option : haser
>         at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
>         at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
>         at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
>         at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
>         at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
>         at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
>         at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
>         at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
>         at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
>         at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
>         at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
>         at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-10-05 13:13:25,299 [tablet.MinorCompactor] WARN : MinC failed (Unknown option :
haser) to create hdfs://localhost:10000/accumulo/tables/2/default_tablet/F0000000.rf_tmp retrying
...
> java.lang.IllegalArgumentException: Unknown option : haser
>         at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
>         at org.apache.accumulo.core.client.sample.AbstractHashSampler.init(AbstractHashSampler.java:81)
>         at org.apache.accumulo.core.sample.impl.SamplerFactory.newSampler(SamplerFactory.java:40)
>         at org.apache.accumulo.core.file.rfile.RFileOperations.openWriter(RFileOperations.java:91)
>         at org.apache.accumulo.core.file.DispatchingFileFactory.openWriter(DispatchingFileFactory.java:74)
>         at org.apache.accumulo.core.file.FileOperations$OpenWriterOperation.build(FileOperations.java:331)
>         at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:201)
>         at org.apache.accumulo.tserver.tablet.MinorCompactor.call(MinorCompactor.java:111)
>         at org.apache.accumulo.tserver.tablet.Tablet.minorCompact(Tablet.java:811)
>         at org.apache.accumulo.tserver.tablet.MinorCompactionTask.run(MinorCompactionTask.java:84)
>         at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
>         at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
>         at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message