hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8165) Move to Hadoop 2.1.0-beta from 2.0.x-alpha (WAS: Update our protobuf to 2.5 from 2.4.1)
Date Tue, 20 Aug 2013 05:47:57 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744731#comment-13744731
] 

stack commented on HBASE-8165:
------------------------------

[~liochon] Maybe need to print out any concurrent processes that survive the kill?

I am trying to figure this fail.  I am concentrating on TestRowCounter.  I compare 2.0.5 runs
to 2.1.0 runs and all is same -- same complaints -- only th 2.1.0 exits silently with this:

{code}
...
  6 2013-08-19 22:41:23,584 WARN  [main] mapreduce.JobSubmitter(256): No job jar file set.
 User classes may not be found. See Job or Job#setJar(String).
  7 2013-08-19 22:41:23,630 DEBUG [main] client.ClientScanner(218): Finished region={ENCODED
=> 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}
  8 2013-08-19 22:41:23,708 ERROR [main] mapreduce.TableInputFormatBase(191): Cannot resolve
the host name for /192.168.1.129 because of javax.naming.NameNotFoundException: DNS name not
found [response code 3]; remaining name '129.1.168.192.in-addr.arpa'
  9 2013-08-19 22:41:23,709 DEBUG [main] mapreduce.TableInputFormatBase(213): getSplits: split
-> 0 -> 192.168.1.129:,
 10 2013-08-19 22:41:23,733 INFO  [IPC Server handler 3 on 63373] blockmanagement.BlockManager(2237):
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:63374 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION,
primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:63374|RBW]]} size 0
 11 2013-08-19 22:41:23,747 INFO  [IPC Server handler 9 on 63373] blockmanagement.BlockManager(2237):
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:63374 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION,
primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:63374|RBW]]} size 0
 12 2013-08-19 22:41:23,757 WARN  [main] conf.Configuration(833): mapred.job.classpath.files
is deprecated. Instead, use mapreduce.job.classpath.files
 13 2013-08-19 22:41:23,757 WARN  [main] conf.Configuration(833): user.name is deprecated.
Instead, use mapreduce.job.user.name
 14 2013-08-19 22:41:23,758 WARN  [main] conf.Configuration(833): mapred.cache.files.filesizes
is deprecated. Instead, use mapreduce.job.cache.files.filesizes
 15 2013-08-19 22:41:23,758 WARN  [main] conf.Configuration(833): fs.default.name is deprecated.
Instead, use fs.defaultFS
 16 2013-08-19 22:41:23,758 WARN  [main] conf.Configuration(833): mapred.cache.files is deprecated.
Instead, use mapreduce.job.cache.files
 17 2013-08-19 22:41:23,759 WARN  [main] conf.Configuration(833): mapreduce.job.counters.limit
is deprecated. Instead, use mapreduce.job.counters.max
 18 2013-08-19 22:41:23,760 WARN  [main] conf.Configuration(833): mapred.cache.files.timestamps
is deprecated. Instead, use mapreduce.job.cache.files.timestamps
 19 2013-08-19 22:41:23,760 WARN  [main] conf.Configuration(833): io.bytes.per.checksum is
deprecated. Instead, use dfs.bytes-per-checksum
 20 2013-08-19 22:41:23,877 INFO  [IPC Server handler 6 on 63373] blockmanagement.BlockManager(2237):
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:63374 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION,
primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:63374|RBW]]} size 0
 21 2013-08-19 22:41:24,409 INFO  [Socket Reader #1 for port 63412] ipc.Server$Connection(1334):
Auth successful for appattempt_1376977272210_0001_000001 (auth:SIMPLE)
 22 2013-08-19 22:41:30,728 WARN  [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(207):
Exit code from container container_1376977272210_0001_01_000001 is : 127
 23 2013-08-19 22:41:30,732 WARN  [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(213):
Exception from container-launch with container ID: container_1376977272210_0001_01_000001
and exit code: 127
...
{code}

Here is 2.0.5 run for compare:

{code}
...
  7 2013-08-19 22:15:38,922 WARN  [main] mapred.JobClient(870): No job jar file set.  User
classes may not be found. See JobConf(Class) or JobConf#setJar(String).
  6 2013-08-19 22:15:38,932 DEBUG [main] client.ClientScanner(218): Finished region={ENCODED
=> 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}
  5 2013-08-19 22:15:39,020 ERROR [main] mapreduce.TableInputFormatBase(191): Cannot resolve
the host name for /192.168.1.129 because of javax.naming.NameNotFoundException: DNS name not
found [response code 3]; remaining name '129.1.168.192.in-addr.arpa'
  4 2013-08-19 22:15:39,021 DEBUG [main] mapreduce.TableInputFormatBase(213): getSplits: split
-> 0 -> 192.168.1.129:,
  3 2013-08-19 22:15:53,716 INFO  [main] hbase.ResourceChecker(171): after: mapreduce.TestRowCounter#testRowCounterNoColumn
Thread=229 (was 225)
...
{code}

I hacked on our testing util to preserve the test output but 2.1.0 container is not writing
any logs (2.0.5 does).
                
> Move to Hadoop 2.1.0-beta from 2.0.x-alpha (WAS: Update our protobuf to 2.5 from 2.4.1)
> ---------------------------------------------------------------------------------------
>
>                 Key: HBASE-8165
>                 URL: https://issues.apache.org/jira/browse/HBASE-8165
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: stack
>             Fix For: 0.98.0, 0.96.0
>
>         Attachments: 8165_trunkv6.txt, 8165.txt, 8165v2.txt, 8165v3.txt, 8165v4.txt,
8165v5.txt, HBASE-8165-rebased.patch
>
>
> Update to new 2.5 pb.  Some speedups and a new PARSER idiom that bypasses making a builder.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message