ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Levas" <rle...@hortonworks.com>
Subject Re: Review Request 31454: Agent is spamming logs with exceptions
Date Thu, 26 Feb 2015 12:12:34 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31454/
-----------------------------------------------------------

(Updated Feb. 26, 2015, 7:12 a.m.)


Review request for Ambari, Andrew Onischuk, Emil Anca, and Vitalyi Brodetskyi.


Bugs: AMBARI-9804
    https://issues.apache.org/jira/browse/AMBARI-9804


Repository: ambari


Description
-------

Snip from log. Notice repeated error message for none error conditions.
```
INFO 2015-01-19 14:00:32,786 PythonExecutor.py:114 - Result: {'structuredOut': {u'securityIssuesFound':
u'Configuration file hbase-site did not pass the vali
dation. Reason: Property hbase.regionserver.keytab.file does not exist', u'processes': [],
u'securityState': u'UNSECURED'}, 'stdout': '2015-01-19 10:10:12,89
4 - Error while executing command \'status\':\nTraceback (most recent call last):\n  File
"/usr/lib/python2.6/site-packages/resource_management/libraries/scr
ipt/script.py", line 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py",
line 
90, in status\n    check_process_status(status_params.datanode_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/ch
eck_process_status.py", line 41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:10:50,579 - Error while exe
cuting command \'status\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
lin
e 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py",
line 90, in status\n    
check_process_status(status_params.datanode_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.
py", line 41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:12:46,728 - Error while executing command \'st
atus\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 184, in execute\n
    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py",
line 90, in status\n    check_process_statu
s(status_params.datanode_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.py",
line 41, in ch
eck_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19 10:12:47,149
- Error while executing command \'status\':\nTraceback 
(most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 184, in execute\n    method(env)\n  
File "/var/lib/ambari-agent/cache/common-services/FLUME/1.4.0.2.0/package/scripts/flume_handler.py",
line 86, in status\n    raise ComponentIsNotRunning()\nC
omponentIsNotRunning\n2015-01-19 10:13:46,533 - Error while executing command \'status\':\nTraceback
(most recent call last):\n  File "/usr/lib/python2.6/sit
e-packages/resource_management/libraries/script/script.py", line 184, in execute\n    method(env)\n
 File "/var/lib/ambari-agent/cache/common-services/HBASE/
0.96.0.2.0/package/scripts/hbase_master.py", line 73, in status\n    check_process_status(pid_file)\n
 File "/usr/lib/python2.6/site-packages/resource_manage
ment/libraries/functions/check_process_status.py", line 41, in check_process_status\n    raise
ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19 10:
13:47,003 - Error while executing command \'status\':\nTraceback (most recent call last):\n
 File "/usr/lib/python2.6/site-packages/resource_management/libra
ries/script/script.py", line 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py
", line 90, in status\n    check_process_status(status_params.datanode_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/func
tions/check_process_status.py", line 41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:13:47,438 - Error w
hile executing command \'status\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.
py", line 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
line
 76, in status\n    check_process_status(pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.py"
, line 41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:13:47,872 - Error while executing command \'statu
s\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 184, in execute\n   
 method(env)\n  File "/var/lib/ambari-agent/cache/common-services/FLUME/1.4.0.2.0/package/scripts/flume_handler.py",
line 86, in status\n    raise ComponentI
sNotRunning()\nComponentIsNotRunning\n2015-01-19 10:19:39,410 - Error while executing command
\'status\':\nTraceback (most recent call last):\n  File "/usr/l
ib/python2.6/site-packages/resource_management/libraries/script/script.py", line 184, in execute\n
   method(env)\n  File "/var/lib/ambari-agent/cache/common
-services/HDFS/2.1.0.2.0/package/scripts/namenode.py", line 110, in status\n    check_process_status(status_params.namenode_pid_file)\n
 File "/usr/lib/pytho
n2.6/site-packages/resource_management/libraries/functions/check_process_status.py", line
41, in check_process_status\n    raise ComponentIsNotRunning()\nCom
ponentIsNotRunning\n2015-01-19 10:19:40,004 - Error while executing command \'status\':\nTraceback
(most recent call last):\n  File "/usr/lib/python2.6/site-
packages/resource_management/libraries/script/script.py", line 184, in execute\n    method(env)\n
 File "/var/lib/ambari-agent/cache/common-services/HBASE/0.
96.0.2.0/package/scripts/hbase_master.py", line 73, in status\n    check_process_status(pid_file)\n
 File "/usr/lib/python2.6/site-packages/resource_manageme
nt/libraries/functions/check_process_status.py", line 41, in check_process_status\n    raise
ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19 10:19
:40,420 - Error while executing command \'status\':\nTraceback (most recent call last):\n
 File "/usr/lib/python2.6/site-packages/resource_management/librari
es/script/script.py", line 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
 line 110, in status\n    check_process_status(status_params.namenode_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/funct
ions/check_process_status.py", line 41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:19:40,852 - Error wh
ile executing command \'status\':\nTraceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.p
y", line 184, in execute\n    method(env)\n  File "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py",
line 73, in
 status\n    check_process_status(pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.py",
line 
41, in check_process_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19
10:19:41,278 - Error while executing command \'status\':\nT
raceback (most recent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 184, in execute\n    method
(env)\n  File "/var/lib/ambari-agent/cache/common-services/KAFKA/0.8.1.2.2/package/scripts/kafka_broker.py",
line 70, in status\n    check_process_status(sta
tus_params.kafka_pid_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.py",
line 41, in check_proc
ess_status\n    raise ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19 10:19:41,676
- Error while executing command \'status\':\nTraceback (most re
cent call last):\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 184, in execute\n    method(env)\n  File "/v
ar/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py", line
90, in status\n    check_process_status(status_params.datanode_pi
d_file)\n  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/check_process_status.py",
line 41, in check_process_status\n    rai
se ComponentIsNotRunning()\nComponentIsNotRunning\n2015-01-19 10:19:42,112 - Error while executing
command \'status\':\nTraceback (most recent call last):\n 
 File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line
184, in execute\n    method(env)\n  File "/var/lib/ambari-agent
```

The solution is to clear the (previosuly cached) error message before setting structured out
data.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/script/script.py 9b3611b 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py
6059a1c 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
0f0f539 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py
db07932 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_client.py
fa890ad 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py
505d0b7 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py
3dfdb88 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/snamenode.py
49249b6 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/zkfc_slave.py
c5b0b1b 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py
8971bf5 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py
45e4d9b 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager.py
53395ca 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
6830a34 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_master.py 82c5404 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 1b0a211 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_datanode.py 90c0ca0 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_hdfs_client.py 005fc0c 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_journalnode.py ae09321 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_namenode.py 18722be 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_snamenode.py e750406 
  ambari-server/src/test/python/stacks/2.0.6/HDFS/test_zkfc.py 911a19b 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_nodemanager.py 06d3902 
  ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py cddb89b 
  ambari-server/src/test/python/stacks/2.0.6/configs/default.json cac0370 
  ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py 8658889 

Diff: https://reviews.apache.org/r/31454/diff/


Testing (updated)
-------

#Jenkins test result:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:15 h
[INFO] Finished at: 2015-02-26T05:14:15+00:00
[INFO] Final Memory: 43M/480M
[INFO] ------------------------------------------------------------------------


Thanks,

Robert Levas


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message