hawq-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Grant Krieger <GKrie...@mrpg.com>
Subject RE: Hawq temp Spill files
Date Sat, 23 Sep 2017 05:06:55 GMT
Hi Kavinder,

I noticed the non dfs space was increasing too much. So we did an investigation. On investigating
we found the cause to be these spill files. I have spill files dating back to 1st August 2017.
I have noticed other smaller files

See below example below

Thanks

Grant

[root@Hadoop-ProdS-A2 workfile_set_HashJoin_Slice4.XXXXFglcDe]# pwd
/grid/2/hawq/data/hawq/tmp/segment/pgsql_tmp/workfile_set_HashJoin_Slice4.XXXXFglcDe
[root@Hadoop-ProdS-A2 workfile_set_HashJoin_Slice4.XXXXFglcDe]# ls -l
total 10167828
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:16 spillfile_f1
-rw-------. 1 gpadmin gpadmin  95387648 Aug  1 14:31 spillfile_f101
-rw-------. 1 gpadmin gpadmin 105054208 Aug  1 14:31 spillfile_f103
-rw-------. 1 gpadmin gpadmin  93044736 Aug  1 14:31 spillfile_f105
-rw-------. 1 gpadmin gpadmin  95502336 Aug  1 14:31 spillfile_f107
-rw-------. 1 gpadmin gpadmin  96043008 Aug  1 14:31 spillfile_f109
-rw-------. 1 gpadmin gpadmin  89161728 Aug  1 14:31 spillfile_f111
-rw-------. 1 gpadmin gpadmin  96026624 Aug  1 14:30 spillfile_f113
-rw-------. 1 gpadmin gpadmin  91996160 Aug  1 14:31 spillfile_f115
-rw-------. 1 gpadmin gpadmin  94699520 Aug  1 14:31 spillfile_f117
-rw-------. 1 gpadmin gpadmin  87408640 Aug  1 14:31 spillfile_f119
-rw-------. 1 gpadmin gpadmin  98631680 Aug  1 14:30 spillfile_f121
-rw-------. 1 gpadmin gpadmin  92160000 Aug  1 14:31 spillfile_f123
-rw-------. 1 gpadmin gpadmin  94470144 Aug  1 14:31 spillfile_f125
-rw-------. 1 gpadmin gpadmin 102481920 Aug  1 14:31 spillfile_f127
-rw-------. 1 gpadmin gpadmin  79380480 Aug  1 14:22 spillfile_f129
-rw-------. 1 gpadmin gpadmin  44793856 Aug  1 14:31 spillfile_f131
-rw-------. 1 gpadmin gpadmin  45367296 Aug  1 14:31 spillfile_f133
-rw-------. 1 gpadmin gpadmin  47562752 Aug  1 14:30 spillfile_f135
-rw-------. 1 gpadmin gpadmin  47022080 Aug  1 14:31 spillfile_f137
-rw-------. 1 gpadmin gpadmin  39616512 Aug  1 14:31 spillfile_f139
-rw-------. 1 gpadmin gpadmin  50413568 Aug  1 14:31 spillfile_f141
-rw-------. 1 gpadmin gpadmin  50135040 Aug  1 14:31 spillfile_f143
-rw-------. 1 gpadmin gpadmin  52117504 Aug  1 14:31 spillfile_f145
-rw-------. 1 gpadmin gpadmin  37404672 Aug  1 14:22 spillfile_f147
-rw-------. 1 gpadmin gpadmin  46923776 Aug  1 14:31 spillfile_f149
-rw-------. 1 gpadmin gpadmin  41107456 Aug  1 14:31 spillfile_f151
-rw-------. 1 gpadmin gpadmin  66289664 Aug  1 14:31 spillfile_f153
-rw-------. 1 gpadmin gpadmin  53510144 Aug  1 14:30 spillfile_f155
-rw-------. 1 gpadmin gpadmin  46202880 Aug  1 14:30 spillfile_f157
-rw-------. 1 gpadmin gpadmin  41680896 Aug  1 14:31 spillfile_f159
-rw-------. 1 gpadmin gpadmin  47136768 Aug  1 14:31 spillfile_f161
-rw-------. 1 gpadmin gpadmin  46563328 Aug  1 14:31 spillfile_f163
-rw-------. 1 gpadmin gpadmin  39747584 Aug  1 14:31 spillfile_f165
-rw-------. 1 gpadmin gpadmin  51773440 Aug  1 14:31 spillfile_f167
-rw-------. 1 gpadmin gpadmin  50692096 Aug  1 14:31 spillfile_f169
-rw-------. 1 gpadmin gpadmin  64339968 Aug  1 14:30 spillfile_f171
-rw-------. 1 gpadmin gpadmin  45744128 Aug  1 14:26 spillfile_f173
-rw-------. 1 gpadmin gpadmin  44498944 Aug  1 14:30 spillfile_f175
-rw-------. 1 gpadmin gpadmin  49102848 Aug  1 14:31 spillfile_f177
-rw-------. 1 gpadmin gpadmin  42663936 Aug  1 14:31 spillfile_f179
-rw-------. 1 gpadmin gpadmin  77496320 Aug  1 14:31 spillfile_f181
-rw-------. 1 gpadmin gpadmin  56213504 Aug  1 14:31 spillfile_f183
-rw-------. 1 gpadmin gpadmin  46874624 Aug  1 14:30 spillfile_f185
-rw-------. 1 gpadmin gpadmin  45629440 Aug  1 14:31 spillfile_f187
-rw-------. 1 gpadmin gpadmin  50462720 Aug  1 14:31 spillfile_f189
-rw-------. 1 gpadmin gpadmin  70860800 Aug  1 14:31 spillfile_f191
-rw-------. 1 gpadmin gpadmin  44236800 Aug  1 14:31 spillfile_f193
-rw-------. 1 gpadmin gpadmin  63012864 Aug  1 14:31 spillfile_f195
-rw-------. 1 gpadmin gpadmin  37683200 Aug  1 14:31 spillfile_f197
-rw-------. 1 gpadmin gpadmin  51609600 Aug  1 14:31 spillfile_f199
-rw-------. 1 gpadmin gpadmin  60358656 Aug  1 14:31 spillfile_f201
-rw-------. 1 gpadmin gpadmin  61947904 Aug  1 14:30 spillfile_f203
-rw-------. 1 gpadmin gpadmin  40239104 Aug  1 14:22 spillfile_f205
-rw-------. 1 gpadmin gpadmin  63733760 Aug  1 14:31 spillfile_f207
-rw-------. 1 gpadmin gpadmin  44498944 Aug  1 14:31 spillfile_f209
-rw-------. 1 gpadmin gpadmin  38797312 Aug  1 14:31 spillfile_f211
-rw-------. 1 gpadmin gpadmin  50364416 Aug  1 14:31 spillfile_f213
-rw-------. 1 gpadmin gpadmin  53919744 Aug  1 14:31 spillfile_f215
-rw-------. 1 gpadmin gpadmin  46284800 Aug  1 14:31 spillfile_f217
-rw-------. 1 gpadmin gpadmin  39419904 Aug  1 14:31 spillfile_f219
-rw-------. 1 gpadmin gpadmin  64110592 Aug  1 14:30 spillfile_f221
-rw-------. 1 gpadmin gpadmin  39387136 Aug  1 14:31 spillfile_f223
-rw-------. 1 gpadmin gpadmin  70057984 Aug  1 14:30 spillfile_f225
-rw-------. 1 gpadmin gpadmin  47824896 Aug  1 14:31 spillfile_f227
-rw-------. 1 gpadmin gpadmin  86016000 Aug  1 14:30 spillfile_f229
-rw-------. 1 gpadmin gpadmin 178094080 Aug  1 14:31 spillfile_f23
-rw-------. 1 gpadmin gpadmin  58785792 Aug  1 14:31 spillfile_f231
-rw-------. 1 gpadmin gpadmin  49217536 Aug  1 14:31 spillfile_f233
-rw-------. 1 gpadmin gpadmin  56393728 Aug  1 14:31 spillfile_f235
-rw-------. 1 gpadmin gpadmin  48955392 Aug  1 14:30 spillfile_f237
-rw-------. 1 gpadmin gpadmin  43499520 Aug  1 14:31 spillfile_f239
-rw-------. 1 gpadmin gpadmin  39485440 Aug  1 14:31 spillfile_f241
-rw-------. 1 gpadmin gpadmin  48381952 Aug  1 14:31 spillfile_f243
-rw-------. 1 gpadmin gpadmin  44597248 Aug  1 14:30 spillfile_f245
-rw-------. 1 gpadmin gpadmin  54181888 Aug  1 14:31 spillfile_f247
-rw-------. 1 gpadmin gpadmin  44023808 Aug  1 14:31 spillfile_f249
-rw-------. 1 gpadmin gpadmin 188875256 Aug  1 14:31 spillfile_f25
-rw-------. 1 gpadmin gpadmin  46039040 Aug  1 14:31 spillfile_f251
-rw-------. 1 gpadmin gpadmin  39174144 Aug  1 14:31 spillfile_f253
-rw-------. 1 gpadmin gpadmin  61554688 Aug  1 14:31 spillfile_f255
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f257
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f259
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f261
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f263
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f267
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f269
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f271
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f273
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f275
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f279
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f281
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f283
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f287
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f291
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f293
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f295
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f297
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f299
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f301
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f303
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f305
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f307
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f309
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f311
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f313
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f315
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f317
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f319
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f321
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f323
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f325
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f327
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f329
-rw-------. 1 gpadmin gpadmin 181911552 Aug  1 14:22 spillfile_f33
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f331
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f333
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f335
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f339
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f343
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f345
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f347
-rw-------. 1 gpadmin gpadmin 139886592 Aug  1 14:31 spillfile_f35
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f351
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f353
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f355
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f357
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f359
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f361
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f363
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f365
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f369
-rw-------. 1 gpadmin gpadmin 125714432 Aug  1 14:31 spillfile_f37
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f371
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f375
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f377
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f379
-rw-------. 1 gpadmin gpadmin  45334528 Aug  1 14:30 spillfile_f381
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:30 spillfile_f383
-rw-------. 1 gpadmin gpadmin  13778944 Aug  1 14:30 spillfile_f385
-rw-------. 1 gpadmin gpadmin   9601024 Aug  1 14:30 spillfile_f387
-rw-------. 1 gpadmin gpadmin   7585792 Aug  1 14:30 spillfile_f389
-rw-------. 1 gpadmin gpadmin 139018240 Aug  1 14:31 spillfile_f39
-rw-------. 1 gpadmin gpadmin   3276800 Aug  1 14:31 spillfile_f391
-rw-------. 1 gpadmin gpadmin   5259264 Aug  1 14:31 spillfile_f393
-rw-------. 1 gpadmin gpadmin   2162688 Aug  1 14:31 spillfile_f395
-rw-------. 1 gpadmin gpadmin  19120128 Aug  1 14:31 spillfile_f397
-rw-------. 1 gpadmin gpadmin  23281664 Aug  1 14:30 spillfile_f399
-rw-------. 1 gpadmin gpadmin  11141120 Aug  1 14:31 spillfile_f401
-rw-------. 1 gpadmin gpadmin   4898816 Aug  1 14:31 spillfile_f403
-rw-------. 1 gpadmin gpadmin   2490368 Aug  1 14:31 spillfile_f405
-rw-------. 1 gpadmin gpadmin  11010048 Aug  1 14:31 spillfile_f407
-rw-------. 1 gpadmin gpadmin   4718592 Aug  1 14:31 spillfile_f409
-rw-------. 1 gpadmin gpadmin 145293312 Aug  1 14:31 spillfile_f41
-rw-------. 1 gpadmin gpadmin   3325952 Aug  1 14:31 spillfile_f411
-rw-------. 1 gpadmin gpadmin  11468800 Aug  1 14:31 spillfile_f413
-rw-------. 1 gpadmin gpadmin   4308992 Aug  1 14:31 spillfile_f415
-rw-------. 1 gpadmin gpadmin  12042240 Aug  1 14:31 spillfile_f417
-rw-------. 1 gpadmin gpadmin  42549248 Aug  1 14:31 spillfile_f419
-rw-------. 1 gpadmin gpadmin   6455296 Aug  1 14:31 spillfile_f421
-rw-------. 1 gpadmin gpadmin   3571712 Aug  1 14:30 spillfile_f423
-rw-------. 1 gpadmin gpadmin   4947968 Aug  1 14:31 spillfile_f425
-rw-------. 1 gpadmin gpadmin   5423104 Aug  1 14:31 spillfile_f427
-rw-------. 1 gpadmin gpadmin   4079616 Aug  1 14:31 spillfile_f429
-rw-------. 1 gpadmin gpadmin 138854400 Aug  1 14:31 spillfile_f43
-rw-------. 1 gpadmin gpadmin   5128192 Aug  1 14:31 spillfile_f431
-rw-------. 1 gpadmin gpadmin   6324224 Aug  1 14:30 spillfile_f433
-rw-------. 1 gpadmin gpadmin  36421632 Aug  1 14:31 spillfile_f435
-rw-------. 1 gpadmin gpadmin  53477376 Aug  1 14:30 spillfile_f437
-rw-------. 1 gpadmin gpadmin   5586944 Aug  1 14:31 spillfile_f439
-rw-------. 1 gpadmin gpadmin   4587520 Aug  1 14:31 spillfile_f441
-rw-------. 1 gpadmin gpadmin  21348352 Aug  1 14:31 spillfile_f443
-rw-------. 1 gpadmin gpadmin   5586944 Aug  1 14:30 spillfile_f445
-rw-------. 1 gpadmin gpadmin   4784128 Aug  1 14:31 spillfile_f447
-rw-------. 1 gpadmin gpadmin   7110656 Aug  1 14:30 spillfile_f449
-rw-------. 1 gpadmin gpadmin 158842880 Aug  1 14:30 spillfile_f45
-rw-------. 1 gpadmin gpadmin   9093120 Aug  1 14:30 spillfile_f451
-rw-------. 1 gpadmin gpadmin   2768896 Aug  1 14:31 spillfile_f453
-rw-------. 1 gpadmin gpadmin   4866048 Aug  1 14:30 spillfile_f455
-rw-------. 1 gpadmin gpadmin   6225920 Aug  1 14:31 spillfile_f457
-rw-------. 1 gpadmin gpadmin   3702784 Aug  1 14:31 spillfile_f459
-rw-------. 1 gpadmin gpadmin   4227072 Aug  1 14:31 spillfile_f461
-rw-------. 1 gpadmin gpadmin  14991360 Aug  1 14:30 spillfile_f463
-rw-------. 1 gpadmin gpadmin   5177344 Aug  1 14:31 spillfile_f465
-rw-------. 1 gpadmin gpadmin  45137920 Aug  1 14:31 spillfile_f467
-rw-------. 1 gpadmin gpadmin   4276224 Aug  1 14:30 spillfile_f469
-rw-------. 1 gpadmin gpadmin 153092096 Aug  1 14:30 spillfile_f47
-rw-------. 1 gpadmin gpadmin   3588096 Aug  1 14:31 spillfile_f471
-rw-------. 1 gpadmin gpadmin  22528000 Aug  1 14:30 spillfile_f473
-rw-------. 1 gpadmin gpadmin  51757056 Aug  1 14:31 spillfile_f475
-rw-------. 1 gpadmin gpadmin   3047424 Aug  1 14:31 spillfile_f477
-rw-------. 1 gpadmin gpadmin  47988736 Aug  1 14:31 spillfile_f479
-rw-------. 1 gpadmin gpadmin   5226496 Aug  1 14:30 spillfile_f481
-rw-------. 1 gpadmin gpadmin   8503296 Aug  1 14:31 spillfile_f483
-rw-------. 1 gpadmin gpadmin   4571136 Aug  1 14:31 spillfile_f485
-rw-------. 1 gpadmin gpadmin   2670592 Aug  1 14:31 spillfile_f487
-rw-------. 1 gpadmin gpadmin  26804224 Aug  1 14:31 spillfile_f489
-rw-------. 1 gpadmin gpadmin 133758976 Aug  1 14:31 spillfile_f49
-rw-------. 1 gpadmin gpadmin   2801664 Aug  1 14:31 spillfile_f491
-rw-------. 1 gpadmin gpadmin   4882432 Aug  1 14:31 spillfile_f493
-rw-------. 1 gpadmin gpadmin   1277952 Aug  1 14:31 spillfile_f495
-rw-------. 1 gpadmin gpadmin  12517376 Aug  1 14:31 spillfile_f497
-rw-------. 1 gpadmin gpadmin  10862592 Aug  1 14:31 spillfile_f499
-rw-------. 1 gpadmin gpadmin  22642688 Aug  1 14:31 spillfile_f501
-rw-------. 1 gpadmin gpadmin  10141696 Aug  1 14:31 spillfile_f503
-rw-------. 1 gpadmin gpadmin   3375104 Aug  1 14:31 spillfile_f505
-rw-------. 1 gpadmin gpadmin   1048576 Aug  1 14:31 spillfile_f507
-rw-------. 1 gpadmin gpadmin   7094272 Aug  1 14:31 spillfile_f509
-rw-------. 1 gpadmin gpadmin 143917056 Aug  1 14:31 spillfile_f51
-rw-------. 1 gpadmin gpadmin   1277952 Aug  1 14:31 spillfile_f511
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:31 spillfile_f513
-rw-------. 1 gpadmin gpadmin  12599296 Aug  1 14:31 spillfile_f515
-rw-------. 1 gpadmin gpadmin   6504448 Aug  1 14:31 spillfile_f517
-rw-------. 1 gpadmin gpadmin   4898816 Aug  1 14:31 spillfile_f519
-rw-------. 1 gpadmin gpadmin   6488064 Aug  1 14:31 spillfile_f521
-rw-------. 1 gpadmin gpadmin   5668864 Aug  1 14:31 spillfile_f523
-rw-------. 1 gpadmin gpadmin  13877248 Aug  1 14:31 spillfile_f525
-rw-------. 1 gpadmin gpadmin   5521408 Aug  1 14:31 spillfile_f527
-rw-------. 1 gpadmin gpadmin   3440640 Aug  1 14:31 spillfile_f529
-rw-------. 1 gpadmin gpadmin 143605760 Aug  1 14:31 spillfile_f53
-rw-------. 1 gpadmin gpadmin   4554752 Aug  1 14:31 spillfile_f531
-rw-------. 1 gpadmin gpadmin  16990208 Aug  1 14:31 spillfile_f533
-rw-------. 1 gpadmin gpadmin  24690688 Aug  1 14:31 spillfile_f535
-rw-------. 1 gpadmin gpadmin  36290560 Aug  1 14:31 spillfile_f537
-rw-------. 1 gpadmin gpadmin  18415616 Aug  1 14:31 spillfile_f539
-rw-------. 1 gpadmin gpadmin   4849664 Aug  1 14:31 spillfile_f541
-rw-------. 1 gpadmin gpadmin  10534912 Aug  1 14:31 spillfile_f543
-rw-------. 1 gpadmin gpadmin  42041344 Aug  1 14:31 spillfile_f545
-rw-------. 1 gpadmin gpadmin   3948544 Aug  1 14:31 spillfile_f547
-rw-------. 1 gpadmin gpadmin   5406720 Aug  1 14:31 spillfile_f549
-rw-------. 1 gpadmin gpadmin 138592256 Aug  1 14:31 spillfile_f55
-rw-------. 1 gpadmin gpadmin  11354112 Aug  1 14:31 spillfile_f551
-rw-------. 1 gpadmin gpadmin  19775488 Aug  1 14:31 spillfile_f553
-rw-------. 1 gpadmin gpadmin   3932160 Aug  1 14:31 spillfile_f555
-rw-------. 1 gpadmin gpadmin   3850240 Aug  1 14:31 spillfile_f557
-rw-------. 1 gpadmin gpadmin   5931008 Aug  1 14:31 spillfile_f559
-rw-------. 1 gpadmin gpadmin  44843008 Aug  1 14:31 spillfile_f561
-rw-------. 1 gpadmin gpadmin   2850816 Aug  1 14:31 spillfile_f563
-rw-------. 1 gpadmin gpadmin   2932736 Aug  1 14:31 spillfile_f565
-rw-------. 1 gpadmin gpadmin   4079616 Aug  1 14:31 spillfile_f567
-rw-------. 1 gpadmin gpadmin   8519680 Aug  1 14:31 spillfile_f569
-rw-------. 1 gpadmin gpadmin 140918784 Aug  1 14:31 spillfile_f57
-rw-------. 1 gpadmin gpadmin  21676032 Aug  1 14:31 spillfile_f571
-rw-------. 1 gpadmin gpadmin   7979008 Aug  1 14:31 spillfile_f573
-rw-------. 1 gpadmin gpadmin  13025280 Aug  1 14:31 spillfile_f575
-rw-------. 1 gpadmin gpadmin  44302336 Aug  1 14:31 spillfile_f577
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:31 spillfile_f579
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:31 spillfile_f581
-rw-------. 1 gpadmin gpadmin   5947392 Aug  1 14:31 spillfile_f583
-rw-------. 1 gpadmin gpadmin   5455872 Aug  1 14:31 spillfile_f585
-rw-------. 1 gpadmin gpadmin   5586944 Aug  1 14:31 spillfile_f587
-rw-------. 1 gpadmin gpadmin  12025856 Aug  1 14:31 spillfile_f589
-rw-------. 1 gpadmin gpadmin 141705216 Aug  1 14:31 spillfile_f59
-rw-------. 1 gpadmin gpadmin  20725760 Aug  1 14:31 spillfile_f591
-rw-------. 1 gpadmin gpadmin   7045120 Aug  1 14:31 spillfile_f593
-rw-------. 1 gpadmin gpadmin  35274752 Aug  1 14:31 spillfile_f595
-rw-------. 1 gpadmin gpadmin   8388608 Aug  1 14:31 spillfile_f597
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:31 spillfile_f599
-rw-------. 1 gpadmin gpadmin   7127040 Aug  1 14:31 spillfile_f601
-rw-------. 1 gpadmin gpadmin   2883584 Aug  1 14:31 spillfile_f603
-rw-------. 1 gpadmin gpadmin   2555904 Aug  1 14:31 spillfile_f605
-rw-------. 1 gpadmin gpadmin  19873792 Aug  1 14:31 spillfile_f607
-rw-------. 1 gpadmin gpadmin   9682944 Aug  1 14:31 spillfile_f609
-rw-------. 1 gpadmin gpadmin 135643136 Aug  1 14:31 spillfile_f61
-rw-------. 1 gpadmin gpadmin   2965504 Aug  1 14:31 spillfile_f611
-rw-------. 1 gpadmin gpadmin   2408448 Aug  1 14:31 spillfile_f613
-rw-------. 1 gpadmin gpadmin  47038464 Aug  1 14:31 spillfile_f615
-rw-------. 1 gpadmin gpadmin         0 Aug  1 14:31 spillfile_f617
-rw-------. 1 gpadmin gpadmin 148799488 Aug  1 14:30 spillfile_f63
-rw-------. 1 gpadmin gpadmin 135970816 Aug  1 14:22 spillfile_f65
-rw-------. 1 gpadmin gpadmin 107560960 Aug  1 14:31 spillfile_f67
-rw-------. 1 gpadmin gpadmin 108953600 Aug  1 14:30 spillfile_f69
-rw-------. 1 gpadmin gpadmin  94060544 Aug  1 14:31 spillfile_f71
-rw-------. 1 gpadmin gpadmin  84983808 Aug  1 14:31 spillfile_f73
-rw-------. 1 gpadmin gpadmin  83001344 Aug  1 14:31 spillfile_f75
-rw-------. 1 gpadmin gpadmin 106053632 Aug  1 14:30 spillfile_f77
-rw-------. 1 gpadmin gpadmin  98959360 Aug  1 14:31 spillfile_f79
-rw-------. 1 gpadmin gpadmin 100499456 Aug  1 14:31 spillfile_f81
-rw-------. 1 gpadmin gpadmin 106659840 Aug  1 14:30 spillfile_f83
-rw-------. 1 gpadmin gpadmin  95240192 Aug  1 14:30 spillfile_f85
-rw-------. 1 gpadmin gpadmin 101613568 Aug  1 14:31 spillfile_f87
-rw-------. 1 gpadmin gpadmin  90144768 Aug  1 14:31 spillfile_f89
-rw-------. 1 gpadmin gpadmin  89358336 Aug  1 14:31 spillfile_f91
-rw-------. 1 gpadmin gpadmin  96501760 Aug  1 14:31 spillfile_f93
-rw-------. 1 gpadmin gpadmin  94765056 Aug  1 14:31 spillfile_f95
-rw-------. 1 gpadmin gpadmin  89620480 Aug  1 14:31 spillfile_f97
-rw-------. 1 gpadmin gpadmin  77692928 Aug  1 14:24 spillfile_f99
[root@Hadoop-ProdS-A2 workfile_set_HashJoin_Slice4.XXXXFglcDe]#

From: Kavinder Dhaliwal [mailto:kdhaliwal@pivotal.io]
Sent: 22 September 2017 6:59 PM
To: user@hawq.incubator.apache.org
Subject: Re: Hawq temp Spill files august

Hi Grant,

Did you notice this after running a specific query or just after having HAWQ running for a
long time. I believe spill files should be cleaned up after each query execution so this potentially
could be a bug.

Kavinder

On Fri, Sep 22, 2017 at 8:05 AM, Grant Krieger <GKrieger@mrpg.com<mailto:GKrieger@mrpg.com>>
wrote:
I Shut hawq down and ran this on all nodes. Not sure if its correct but at least removed all
files that were problematic and all seems good now

locate workfile_set_Sort_Slice -b | xargs rm -r -f



[Mr PriceGroup Limited]


Grant Krieger
Portfolio Lead
mrp IT
T: +27313108478<tel:+27%2031%20310%208478>
E: gkrieger@mrpg.com<mailto:gkrieger@mrpg.com>
W: http://www.mrpricegroup.com



The information contained in this communication from gkrieger@mrpg.com<mailto:gkrieger@mrpg.com>
is confidential and may be legally privileged. This email is intended solely for use by the
addressee and others authorized to receive it, and should not be read if delivered in error.
If you are not the addressee you are hereby notified that any disclosure, copying, distribution
or action taken or omitted in reliance of the contents of this information is strictly prohibited
and may be unlawful. Please notify the sender immediately if the e-mail has unintentionally
reached you. The email legal notice that governs the transmission of this electronic communication
is available online at Mr Price Group Limited (http://www.mrpricegroup.com/LegalNotice.aspx).
If you cannot access the legal notice, kindly contact us on +27 800 21 2535 and a copy will
be provided to you.

Mr Price Group is an Authorised Financial Services and Credit Provider: FSP31450 and NCRCP46.

PPlease consider the environment before printing this email.
From: Grant Krieger
Sent: 22 September 2017 10:03 AM
To: 'user@hawq.incubator.apache.org<mailto:user@hawq.incubator.apache.org>' <user@hawq.incubator.apache.org<mailto:user@hawq.incubator.apache.org>>
Subject: Hawq temp Spill files

Hi All,

Recently I noticed a huge about of non dfs space taken up. On investigating it appears it’s
the Hawq temp spill files which are taking up the space. In particular 1 file

/grid/0/hawq/data/hawq/tmp/segment/pgsql_tmp/workfile_set_Sort_Slice2.XXXX57PNmW/spillfile_f2

This file takes up  0.5TB on each drive and on each segment. I have not limited the spill
files at all nor set zlib compression. I have gone with the default. Has anyone tried any
of these settings?

Are there any recommendations for cleaning these temp files up I am battling to find anything
on the internet other than moving the location or setting the limit. I understand there might
be a performance impact but I have a feeling adhoc analysis might have caused this

Many thanks

Grant




Mime
View raw message