hbase-builds mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lars hofhansl <lhofha...@yahoo.com>
Subject Re: "Column family prefix used twice" (was Re: Build failed in Jenkins: HBase-0.94 #443)
Date Mon, 09 Sep 2013 04:50:25 GMT
And thanks for tracking it down, Andy!

-- Lars



________________________________
 From: Andrew Purtell <apurtell@apache.org>
To: "dev@hbase.apache.org" <dev@hbase.apache.org>; Lars Hofhansl <lhofhansl@yahoo.com>

Cc: builds@hbase.apache.org 
Sent: Sunday, September 8, 2013 2:54 PM
Subject: Re: "Column family prefix used twice" (was Re: Build failed in Jenkins: HBase-0.94
#443)
 

A bisect confirmed with a test Jenkins job points to

2b6e4e62b6a1e110b8219e4bf20ee4e20e226b17 is the first bad commit
commit 2b6e4e62b6a1e110b8219e4bf20ee4e20e226b17
Author: Lars Hofhansl <larsh@apache.org>
Date:   Wed Sep 4 23:23:51 2013 +0000

    HBASE-8930 Filter evaluates KVs outside requested columns (Vasu
Mariyala)

    git-svn-id:
https://svn.apache.org/repos/asf/hbase/branches/0.94@152017113f79535-47bb-0310-9956-ffa450edef68




On Sat, Sep 7, 2013 at 12:10 PM, Andrew Purtell <apurtell@apache.org> wrote:

> I'm looking into several recent failed 0.94 builds on EC2 Jenkins. Several
> of the failures look like this:
>
> Error Message
>
>
> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>
>
>
>
>
> Stacktrace
>
>
> java.lang.AssertionError: Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>
>     at org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics.validateMetricChanges(SchemaMetrics.java:885)
>
>     at org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange.testScannerSelection(TestScannerSelectionUsingKeyRange.java:125)
>
>
> Running the failing tests locally 100 times in a loop does not reproduce,
> I'm only seeing this on the EC2 test slaves.
>
> At this point I don't know enough to implicate any particular recent
> change. Could also be some kind of formerly latent bug. Going to try test
> reverts of recent changes.
>
> I've also increased the build frequency for the EC2 HBase-0.94 job to on
> every checkin plus every 4 hours.
>
>
> On Sat, Sep 7, 2013 at 9:20 AM, <apurtell@apache.org> wrote:
>
>> See <http://jenkins-public.iridiant.net/job/HBase-0.94/443/>
>>
>> ------------------------------------------
>> [...truncated 7739 lines...]
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.152 sec
>> Running
>> org.apache.hadoop.hbase.regionserver.TestBatchHRegionLockingAndWrites
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.34 sec
>> Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.941 sec
>> Running
>> org.apache.hadoop.hbase.regionserver.TestMiniBatchOperationInProgress
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec
>> Running org.apache.hadoop.hbase.regionserver.TestCompaction
>> Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.15 sec
>> Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaConfigured
>> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec
>> Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.302 sec
>> Running org.apache.hadoop.hbase.regionserver.TestCompactSelection
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.063 sec
>> Running org.apache.hadoop.hbase.regionserver.TestScanner
>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.683 sec
>> Running
>> org.apache.hadoop.hbase.regionserver.TestMultiVersionConsistencyControl
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.009 sec
>> Running org.apache.hadoop.hbase.regionserver.TestMemStore
>> Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.905
>> sec
>> Running org.apache.hadoop.hbase.TestHDFSBlocksDistribution
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.hadoop.hbase.TestSerialization
>> Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec
>> Running org.apache.hadoop.hbase.metrics.TestExponentiallyDecayingSample
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
>> Running org.apache.hadoop.hbase.metrics.TestMetricsHistogram
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec
>> Running org.apache.hadoop.hbase.metrics.TestExactCounterMetric
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
>> Running
>> org.apache.hadoop.hbase.metrics.file.TestTimeStampingMetricsContext
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.015 sec
>> Running org.apache.hadoop.hbase.TestNodeHealthCheckChore
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.054 sec
>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec
>> Running
>> org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.409 sec
>> Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.786 sec
>> Running org.apache.hadoop.hbase.filter.TestColumnPrefixFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.754 sec
>> Running org.apache.hadoop.hbase.filter.TestFuzzyRowFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec
>> Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
>> Running org.apache.hadoop.hbase.filter.TestBitComparator
>> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.filter.TestPageFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.filter.TestColumnPaginationFilter
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.filter.TestFilterList
>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.hadoop.hbase.filter.TestColumnCountGetFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec
>> Running org.apache.hadoop.hbase.filter.TestRandomRowFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.289 sec
>> Running org.apache.hadoop.hbase.filter.TestDependentColumnFilter
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.142 sec
>> Running org.apache.hadoop.hbase.filter.TestParseFilter
>> Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.169 sec
>> Running org.apache.hadoop.hbase.filter.TestInvocationRecordFilter
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec
>> Running org.apache.hadoop.hbase.filter.TestMultipleColumnPrefixFilter
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.082 sec
>> Running org.apache.hadoop.hbase.filter.TestFilter
>> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.305 sec
>> Running org.apache.hadoop.hbase.filter.TestSingleColumnValueFilter
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec
>> Running org.apache.hadoop.hbase.filter.TestPrefixFilter
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec
>> Running org.apache.hadoop.hbase.util.TestDynamicClassLoader
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.93 sec
>> Running org.apache.hadoop.hbase.util.TestKeying
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.hadoop.hbase.util.TestBytes
>> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.389 sec
>> Running org.apache.hadoop.hbase.util.TestByteBufferUtils
>> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec
>> Running org.apache.hadoop.hbase.util.TestThreads
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.008 sec
>> Running org.apache.hadoop.hbase.util.TestRegionSplitCalculator
>> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec
>> Running org.apache.hadoop.hbase.util.TestLoadTestKVGenerator
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.488 sec
>> Running org.apache.hadoop.hbase.util.TestBase64
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.util.TestByteBloomFilter
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.717 sec
>> Running org.apache.hadoop.hbase.util.TestCompressionTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 sec
>> Running org.apache.hadoop.hbase.util.TestHBaseFsckComparator
>> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec
>> Running org.apache.hadoop.hbase.util.TestIncrementingEnvironmentEdge
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.hadoop.hbase.util.TestSortedCopyOnWriteSet
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
>> Running org.apache.hadoop.hbase.util.TestRootPath
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.util.TestHFileArchiveUtil
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
>> Running org.apache.hadoop.hbase.TestServerName
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
>> Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable
>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec
>> Running org.apache.hadoop.hbase.io.TestHalfStoreFileReader
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec
>> Running org.apache.hadoop.hbase.io.TestImmutableBytesWritable
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.hadoop.hbase.io.TestHeapSize
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.544 sec
>> Running org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.483 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestReseekTo
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestBlockCacheColumnFamilySummary
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestHFileDataBlockEncoder
>> Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec
>> Running
>> org.apache.hadoop.hbase.io.hfile.TestHFileInlineToRootChunkConversion
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec
>> Running org.apache.hadoop.hbase.io.hfile.slab.TestSlab
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestHFile
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestSeekTo
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.052 sec
>> Running org.apache.hadoop.hbase.io.hfile.TestHFileWriterV2
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.557 sec
>> Running org.apache.hadoop.hbase.security.TestUser
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 sec
>> Running org.apache.hadoop.hbase.TestHTableDescriptor
>> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.hadoop.hbase.master.TestCatalogJanitor
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.564 sec
>> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotManager
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec
>> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotHFileCleaner
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
>> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotLogCleaner
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
>> Running org.apache.hadoop.hbase.master.cleaner.TestCleanerChore
>> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.054 sec
>> Running org.apache.hadoop.hbase.master.cleaner.TestHFileLinkCleaner
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.015 sec
>> Running org.apache.hadoop.hbase.TestHServerAddress
>> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 sec
>> Running org.apache.hadoop.hbase.TestClassFinder
>> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.864 sec
>> Running org.apache.hadoop.hbase.mapreduce.hadoopbackport.TestJarFinder
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.085 sec
>> Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
>> Running org.apache.hadoop.hbase.mapreduce.TestTableSplit
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec
>> Running org.apache.hadoop.hbase.TestHRegionLocation
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 270.276
>> sec
>> Running org.apache.hadoop.hbase.io.hfile.TestHFileReaderV1
>> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 270.276
>> sec <<< FAILURE!
>> Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange
>> Tests run: 3, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 270.276
>> sec <<< FAILURE!
>> Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL
>> Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 270.276
>> sec <<< FAILURE!
>>
>> Results :
>>
>> Failed tests:
>> testReadingExistingVersion1HFile(org.apache.hadoop.hbase.io.hfile.TestHFileReaderV1):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[0](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[1](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[2](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[0](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[1](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[2](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[3](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[4](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> testScannerSelection[5](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL):
>> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops
>>
>> Tests run: 693, Failures: 10, Errors: 0, Skipped: 0
>>
>

-- 
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message