ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Onischuk" <aonis...@hortonworks.com>
Subject Re: Review Request 33477: Issues when log/pid dirs are customized - Hive
Date Thu, 23 Apr 2015 13:57:15 GMT


> On April 23, 2015, 1:15 p.m., Robert Levas wrote:
> > ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py,
line 270
> > <https://reviews.apache.org/r/33477/diff/1/?file=940346#file940346line270>
> >
> >     Where is `/configurations/hive-site/hive.exec.scratchdir` comming from?  Shouldn't
there be a property set up for it in common-services/HIVE/0.12.0.2.0/configuration/hive-site.xml?

Seems like it's in hive starting from Hive 2.2. For Hive on previous versions it will cause
exception. We should fix this as well.

Emil, please add change like this:

if not params.hive_exec_scratchdir.startswith("/tmp"):
->
is not is_empty(hive_exec_scratchdir) and not params.hive_exec_scratchdir.startswith("/tmp"):


- Andrew


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33477/#review81309
-----------------------------------------------------------


On April 23, 2015, 12:05 p.m., Emil Anca wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33477/
> -----------------------------------------------------------
> 
> (Updated April 23, 2015, 12:05 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk and Robert Levas.
> 
> 
> Bugs: AMBARI-10691
>     https://issues.apache.org/jira/browse/AMBARI-10691
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Problem:
> 
> I ran Ambari 1.7 to install HDP 2.2 on a VM after changing all the /var/log, /var/run,
/hadoop references form defaults to instead be under some other dir. I am encountering a number
of Ambari failures which I needed help on.
> After the install wizard error out I also noticed:
> HS2 does not stay up. From the logs I see below error
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
Permission denied: user=hive, access=WRITE, inode="/":hdfs:hdfs:drwxr-xr-x
> 
> Solution:
> 
> When hive uses a custom hive.exec.scratchdir path on the Hadoop Filesystem, it automatically
tries to create said path at start and it will fail to do so as it does not have the required
permissions.
> Ambari will create said custom folder if needed and set the appropiate permissions.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_service.py
f7266f1 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
b93d056 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py ecba234 
>   ambari-server/src/test/python/stacks/2.0.6/configs/default.json 90cae08 
>   ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 6cce47c 
> 
> Diff: https://reviews.apache.org/r/33477/diff/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Ambari Main ....................................... SUCCESS [6.912s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.116s]
> [INFO] Ambari Web ........................................ SUCCESS [29.655s]
> [INFO] Ambari Views ...................................... SUCCESS [1.196s]
> [INFO] Ambari Admin View ................................. SUCCESS [19.873s]
> [INFO] Ambari Metrics Common ............................. SUCCESS [1.116s]
> [INFO] Ambari Server ..................................... SUCCESS [2:39.489s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.179s]
> [INFO] Ambari Client ..................................... SUCCESS [0.202s]
> [INFO] Ambari Python Client .............................. SUCCESS [1.121s]
> [INFO] Ambari Groovy Client .............................. SUCCESS [2.917s]
> [INFO] Ambari Shell ...................................... SUCCESS [0.108s]
> [INFO] Ambari Python Shell ............................... SUCCESS [0.637s]
> [INFO] Ambari Groovy Shell ............................... SUCCESS [1.760s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> 
> 
> Thanks,
> 
> Emil Anca
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message