hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Problem in Hadoop(0.20.2) with hive
Date Wed, 20 Jul 2011 13:09:19 GMT
Vikas,

Could be two things if you look at the surface of it:

1. Your host config on NN is wrong, and hadoopnametes is resolving to
localhost on it, leading the NN to listen to only localhost. While on
other nodes, the hostname is resolving to an external network
interface address.
2. A firewall is blocking your connection from the hive client machine to NN.

On Wed, Jul 20, 2011 at 5:32 PM, Vikas Srivastava
<vikas.srivastava@one97.net> wrote:
> hey harsh
>
> now i m getting
> java.net.ConnectException: Call to hadoopnametes/10.0.8.47:9001 failed on
> connection exception: java.net.ConnectException: Connection refused
>         at org.apache.hadoop.ipc.Client.wrapException(Client.java:767)
>         at org.apache.hadoop.ipc.Client.call(Client.java:743)
>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>         at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown
> Source)
>         at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>         at
> org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:429)
>         at org.apache.hadoop.mapred.JobClient.init(JobClient.java:423)
>         at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:410)
>         at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:394)
>         at
> org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:132)
>         at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1239)
>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1051)
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:886)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:358)
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:593)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>         at
> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
>         at
> org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:304)
>         at
> org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:860)
>         at org.apache.hadoop.ipc.Client.call(Client.java:720)
>         ... 21 more
> Job Submission failed with exception 'java.net.ConnectException(Call to
> hadoopnametes/10.0.8.47:9001 failed on connection exception:
> java.net.ConnectException: Connection refused)'
>
>
> On Wed, Jul 20, 2011 at 3:28 PM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Vikas,
>>
>> The message is right there:
>>
>> Caused by: java.lang.IllegalArgumentException: Wrong FS:
>>
>> hdfs://10.0.8.47:9000/tmp/hive-hadoop/hive_2011-07-20_14-10-31_091_5919378326346525810,
>> expected: hdfs://hadoopnametes:9000
>>
>> For your fs.default.name config, avoid putting in an IP, and place a
>> hostname instead.
>>
>> On Wed, Jul 20, 2011 at 2:30 PM, Vikas Srivastava
>> <vikas.srivastava@one97.net> wrote:
>> > HI Team,
>> >
>> > i m facing problem. please help me out its a testing sever
>> >
>> > showing this error while running query on datanode!!!!!!!!
>> >
>> >
>> > FAILED: Hive Internal Error: java.lang.RuntimeException(Error while
>> > making
>> > MR scratch directory - check filesystem config (null))
>> > java.lang.RuntimeException: Error while making MR scratch directory -
>> > check
>> > filesystem config (null)
>> >         at
>> > org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:200)
>> >         at
>> > org.apache.hadoop.hive.ql.Context.getMRTmpFileURI(Context.java:251)
>> >         at
>> >
>> > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1013)
>> >         at
>> >
>> > org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7155)
>> >         at
>> >
>> > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:238)
>> >         at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:377)
>> >         at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:335)
>> >         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:844)
>> >         at
>> > org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
>> >         at
>> > org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:358)
>> >         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:593)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> >
>> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> >         at
>> >
>> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >         at java.lang.reflect.Method.invoke(Method.java:597)
>> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> > Caused by: java.lang.IllegalArgumentException: Wrong FS:
>> >
>> > hdfs://10.0.8.47:9000/tmp/hive-hadoop/hive_2011-07-20_14-10-31_091_5919378326346525810,
>> > expected: hdfs://hadoopnametes:9000
>> >         at
>> > org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310)
>> >         at
>> >
>> > org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
>> >         at
>> > org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:222)
>> >         at
>> >
>> > org.apache.hadoop.hdfs.DistributedFileSystem.makeQualified(DistributedFileSystem.java:116)
>> >         at
>> > org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:148)
>> >         at
>> > org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:194)
>> >         ... 15 more
>> >
>> >
>> >
>> >
>> > --
>> > With Regards
>> > Vikas Srivastava
>> >
>> > DWH & Analytics Team
>> > Mob:+91 9560885900
>> > One97 | Let's get talking !
>> >
>>
>>
>>
>> --
>> Harsh J
>
>
>
> --
> With Regards
> Vikas Srivastava
>
> DWH & Analytics Team
> Mob:+91 9560885900
> One97 | Let's get talking !
>



-- 
Harsh J

Mime
View raw message