ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmytro Sen" <d...@hortonworks.com>
Subject Review Request 31357: AMS: ResultSpooler spill files are left behind in /tmp folder
Date Tue, 24 Feb 2015 15:15:39 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31357/
-----------------------------------------------------------

Review request for Ambari and Myroslav Papirkovskyy.


Bugs: AMBARI-9771
    https://issues.apache.org/jira/browse/AMBARI-9771


Repository: ambari


Description
-------

I've seen behavior, described in PHOENIX-1395, on Ambari cluster (200 nodes)
After 3 days running, /tmp folder is full of ResultSpool files
[root@perf-200-20feb-b-ams-1 ~]# ls -la /tmp/
total 4238768
drwxrwxrwt.  6 root root        4096 Feb 23 10:13 .
dr-xr-xr-x. 24 root root        4096 Feb 20 14:55 ..
drwxr-xr-x.  2 hdfs root        4096 Feb 20 16:46 hadoop-hdfs
drwxr-xr-x.  2 ams  hadoop      4096 Feb 20 18:19 hsperfdata_ams
drwxrwxrwt.  2 root root        4096 Feb 20 14:16 .ICE-unix
drwxr-xr-x.  5 ams  hadoop      4096 Feb 20 18:20 Jetty_0_0_0_0_6188_applicationhistory____g7149g
-rw-r--r--.  1 root root         617 Feb 20 14:16 keyfile.1115.pub
-rwxrwxrwx.  1 root root     2557032 Feb 20 17:59 libyjpagent.so
-rw-r--r--.  1 ams  hadoop  16676205 Feb 22 11:36 ResultSpooler1083719173569401088.bin
-rw-r--r--.  1 ams  hadoop  71227095 Feb 22 02:10 ResultSpooler1095642585411691664.bin
-rw-r--r--.  1 ams  hadoop  48685977 Feb 22 11:32 ResultSpooler1119370459591752039.bin
-rw-r--r--.  1 ams  hadoop  64366788 Feb 21 02:24 ResultSpooler1249566735083013570.bin
-rw-r--r--.  1 ams  hadoop 102519737 Feb 21 15:15 ResultSpooler1434399174629975447.bin
-rw-r--r--.  1 ams  hadoop  62280357 Feb 21 07:04 ResultSpooler1523399749056056116.bin
-rw-r--r--.  1 ams  hadoop  99096145 Feb 21 23:28 ResultSpooler1591731371355221216.bin
-rw-r--r--.  1 ams  hadoop  33274946 Feb 22 07:42 ResultSpooler1763163145889847809.bin
-rw-r--r--.  1 ams  hadoop  29906801 Feb 22 06:45 ResultSpooler1924668033838582502.bin
-rw-r--r--.  1 ams  hadoop  79817760 Feb 20 18:19 ResultSpooler2061194340898298157.bin
-rw-r--r--.  1 ams  hadoop  39832796 Feb 22 11:32 ResultSpooler2084948115978783352.bin
-rw-r--r--.  1 ams  hadoop  16340565 Feb 22 11:07 ResultSpooler2151011123128612740.bin
-


Diffs
-----

  ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java
af05d93 

Diff: https://reviews.apache.org/r/31357/diff/


Testing
-------

[INFO] ambari-metrics .................................... SUCCESS [0.902s]
[INFO] Ambari Metrics Common ............................. SUCCESS [3.730s]
[INFO] Ambari Metrics Hadoop Sink ........................ SUCCESS [3.699s]
[INFO] Ambari Metrics Flume Sink ......................... SUCCESS [1.508s]
[INFO] Ambari Metrics Kafka Sink ......................... SUCCESS [3.103s]
[INFO] Ambari Metrics Storm Sink ......................... SUCCESS [2.021s]
[INFO] Ambari Metrics Collector .......................... SUCCESS [4:44.470s]
[INFO] Ambari Metrics Monitor ............................ SUCCESS [7.022s]
[INFO] Ambari Metrics Assembly ........................... SUCCESS [2:37.007s]


Thanks,

Dmytro Sen


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message