lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Not deleting temp files after updating/optimising.
Date Mon, 26 Apr 2004 18:48:05 GMT
Win32 seems to sometimes not permit one to delete a file immediately 
after it has been closed.  Because of this, Lucene keeps a list of files 
that need to be deleted in the 'deleteable' file.  Are your files listed 
in this file?  If so, Lucene will again try to delete these files the 
next time the index is modified.  Perhaps we should add a public method 
which tries to delete such files...

Doug

Paul Williams wrote:
> Hi,
> 
> I am currently using Java 1.4.2_03 with Lucene 1.3 Final. I am using the
> option setUseCompoundFile(true) as I have a lot of fields in the database
> schema, and it can cause the dreaded 'too many open file error' on Windows
> based systems. (Optimising after 1000 documents with a merge factor of a
> 100)
> 
> But I am having a problem with updating a reasonable sized index. It seems
> to leave temporary files which can treble the size of the index on the hard
> disk. (You can delete these file afterwards with no ill effects)
> 
> I have checked to make sure no other processes are locking these files
> (virus checker/backup software etc.) 
> 
> See the directory listing below for the index files.
> 
> Has anyone else had a similar problem? And hopefully come up with a
> solution!!
> 
> Regards,
> 
> Paul
> 
> 15/04/2004  11:05       <DIR>          .
> 15/04/2004  11:05       <DIR>          ..
> 15/04/2004  10:55                    4 deletable
> 15/04/2004  11:05                    0 dir.txt
> 15/04/2004  10:55                   76 segments
> 11/04/2004  09:22          516,150,272 _11au.fdt
> 11/04/2004  09:22               12,288 _11au.fdx
> 11/04/2004  09:19                1,169 _11au.fnm
> 11/04/2004  15:00        3,969,914,880 _12nq.fdt
> 11/04/2004  15:00              283,648 _12nq.fdx
> 11/04/2004  14:39                1,169 _12nq.fnm
> 14/04/2004  17:14        5,689,259,942 _15ar.cfs
> 15/04/2004  10:17                5,462 _15ar.del
> 14/04/2004  17:19            8,619,569 _15e0.cfs
> 15/04/2004  10:12                   21 _15e0.del
> 15/04/2004  07:58              563,730 _15es.cfs
> 15/04/2004  08:25              394,474 _15fg.cfs
> 15/04/2004  10:18              663,616 _15g5.cfs
> 15/04/2004  10:55                9,385 _15g9.cfs
> 10/04/2004  16:06          939,758,592 _vas.fdt
> 10/04/2004  16:06               25,600 _vas.fdx
> 10/04/2004  16:01                1,169 _vas.fnm
> 10/04/2004  16:23          656,837,632 _vuu.fdt
> 10/04/2004  16:23               23,552 _vuu.fdx
> 10/04/2004  16:20                1,169 _vuu.fnm
> 10/04/2004  17:39           98,271,232 _y6h.fdt
> 10/04/2004  17:38                2,048 _y6h.fdx
> 10/04/2004  17:38                1,169 _y6h.fnm
> 10/04/2004  17:42           76,907,520 _y9k.cfs
> 10/04/2004  17:42                1,060 _y9k.f1
> 10/04/2004  17:42                1,060 _y9k.f10
> 10/04/2004  17:42                1,060 _y9k.f100
> 10/04/2004  17:42                1,060 _y9k.f101
> 10/04/2004  17:42                1,060 _y9k.f102
> 10/04/2004  17:42                1,060 _y9k.f103
> 10/04/2004  17:42                1,060 _y9k.f104
> 10/04/2004  17:42                1,060 _y9k.f105
> 10/04/2004  17:42                1,060 _y9k.f106
> 10/04/2004  17:42                1,060 _y9k.f107
> 10/04/2004  17:42                1,060 _y9k.f108
> 10/04/2004  17:42                1,060 _y9k.f109
> 10/04/2004  17:42                1,060 _y9k.f11
> 10/04/2004  17:42                1,060 _y9k.f110
> 10/04/2004  17:42                1,060 _y9k.f111
> 10/04/2004  17:42                1,060 _y9k.f112
> 10/04/2004  17:42                1,060 _y9k.f113
> 10/04/2004  17:42                1,060 _y9k.f114
> 10/04/2004  17:42                1,060 _y9k.f115
> 10/04/2004  17:42                1,060 _y9k.f116
> 10/04/2004  17:42                1,060 _y9k.f117
> 10/04/2004  17:42                1,060 _y9k.f118
> 10/04/2004  17:42                1,060 _y9k.f119
> 10/04/2004  17:42                1,060 _y9k.f12
> 10/04/2004  17:42                1,060 _y9k.f120
> 10/04/2004  17:42                1,060 _y9k.f13
> 10/04/2004  17:42                1,060 _y9k.f14
> 10/04/2004  17:42                1,060 _y9k.f15
> 10/04/2004  17:42                1,060 _y9k.f16
> 10/04/2004  17:42                1,060 _y9k.f17
> 10/04/2004  17:42                1,060 _y9k.f18
> 10/04/2004  17:42                1,060 _y9k.f19
> 10/04/2004  17:42                1,060 _y9k.f2
> 10/04/2004  17:42                1,060 _y9k.f20
> 10/04/2004  17:42                1,060 _y9k.f21
> 10/04/2004  17:42                1,060 _y9k.f22
> 10/04/2004  17:42                1,060 _y9k.f23
> 10/04/2004  17:42                1,060 _y9k.f24
> 10/04/2004  17:42                1,060 _y9k.f25
> 10/04/2004  17:42                1,060 _y9k.f26
> 10/04/2004  17:42                1,060 _y9k.f27
> 10/04/2004  17:42                1,060 _y9k.f28
> 10/04/2004  17:42                1,060 _y9k.f29
> 10/04/2004  17:42                1,060 _y9k.f3
> 10/04/2004  17:42                1,060 _y9k.f30
> 10/04/2004  17:42                1,060 _y9k.f31
> 10/04/2004  17:42                1,060 _y9k.f32
> 10/04/2004  17:42                1,060 _y9k.f33
> 10/04/2004  17:42                1,060 _y9k.f34
> 10/04/2004  17:42                1,060 _y9k.f35
> 10/04/2004  17:42                1,060 _y9k.f36
> 10/04/2004  17:42                1,060 _y9k.f37
> 10/04/2004  17:42                1,060 _y9k.f38
> 10/04/2004  17:42                1,060 _y9k.f39
> 10/04/2004  17:42                1,060 _y9k.f4
> 10/04/2004  17:42                1,060 _y9k.f40
> 10/04/2004  17:42                1,060 _y9k.f41
> 10/04/2004  17:42                1,060 _y9k.f42
> 10/04/2004  17:42                1,060 _y9k.f43
> 10/04/2004  17:42                1,060 _y9k.f44
> 10/04/2004  17:42                1,060 _y9k.f45
> 10/04/2004  17:42                1,060 _y9k.f46
> 10/04/2004  17:42                1,060 _y9k.f47
> 10/04/2004  17:42                1,060 _y9k.f48
> 10/04/2004  17:42                1,060 _y9k.f49
> 10/04/2004  17:42                1,060 _y9k.f5
> 10/04/2004  17:42                1,060 _y9k.f50
> 10/04/2004  17:42                1,060 _y9k.f51
> 10/04/2004  17:42                1,060 _y9k.f52
> 10/04/2004  17:42                1,060 _y9k.f53
> 10/04/2004  17:42                1,060 _y9k.f54
> 10/04/2004  17:42                1,060 _y9k.f55
> 10/04/2004  17:42                1,060 _y9k.f56
> 10/04/2004  17:42                1,060 _y9k.f57
> 10/04/2004  17:42                1,060 _y9k.f58
> 10/04/2004  17:42                1,060 _y9k.f59
> 10/04/2004  17:42                1,060 _y9k.f6
> 10/04/2004  17:42                1,060 _y9k.f60
> 10/04/2004  17:42                1,060 _y9k.f61
> 10/04/2004  17:42                1,060 _y9k.f62
> 10/04/2004  17:42                1,060 _y9k.f63
> 10/04/2004  17:42                1,060 _y9k.f64
> 10/04/2004  17:42                1,060 _y9k.f65
> 10/04/2004  17:42                1,060 _y9k.f66
> 10/04/2004  17:42                1,060 _y9k.f67
> 10/04/2004  17:42                1,060 _y9k.f68
> 10/04/2004  17:42                1,060 _y9k.f69
> 10/04/2004  17:42                1,060 _y9k.f7
> 10/04/2004  17:42                1,060 _y9k.f70
> 10/04/2004  17:42                1,060 _y9k.f71
> 10/04/2004  17:42                1,060 _y9k.f72
> 10/04/2004  17:42                1,060 _y9k.f73
> 10/04/2004  17:42                1,060 _y9k.f74
> 10/04/2004  17:42                1,060 _y9k.f75
> 10/04/2004  17:42                1,060 _y9k.f76
> 10/04/2004  17:42                1,060 _y9k.f77
> 10/04/2004  17:42                1,060 _y9k.f78
> 10/04/2004  17:42                1,060 _y9k.f79
> 10/04/2004  17:42                1,060 _y9k.f8
> 10/04/2004  17:42                1,060 _y9k.f80
> 10/04/2004  17:42                1,060 _y9k.f81
> 10/04/2004  17:42                1,060 _y9k.f82
> 10/04/2004  17:42                1,060 _y9k.f83
> 10/04/2004  17:42                1,060 _y9k.f84
> 10/04/2004  17:42                1,060 _y9k.f85
> 10/04/2004  17:42                1,060 _y9k.f86
> 10/04/2004  17:42                1,060 _y9k.f87
> 10/04/2004  17:42                1,060 _y9k.f88
> 10/04/2004  17:42                1,060 _y9k.f89
> 10/04/2004  17:42                1,060 _y9k.f9
> 10/04/2004  17:42                1,060 _y9k.f90
> 10/04/2004  17:42                1,060 _y9k.f91
> 10/04/2004  17:42                1,060 _y9k.f92
> 10/04/2004  17:42                1,060 _y9k.f93
> 10/04/2004  17:42                1,060 _y9k.f94
> 10/04/2004  17:42                1,060 _y9k.f95
> 10/04/2004  17:42                1,060 _y9k.f96
> 10/04/2004  17:42                1,060 _y9k.f97
> 10/04/2004  17:42                1,060 _y9k.f98
> 10/04/2004  17:42                1,060 _y9k.f99
> 10/04/2004  17:41          193,259,415 _y9k.fdt
> 10/04/2004  17:41                8,480 _y9k.fdx
> 10/04/2004  17:41                1,169 _y9k.fnm
> 10/04/2004  17:42            3,594,942 _y9k.frq
> 10/04/2004  17:42           11,449,010 _y9k.prx
> 10/04/2004  17:42               35,403 _y9k.tii
> 10/04/2004  17:42            2,577,708 _y9k.tis
>              154 File(s) 12,168,762,715 bytes
>                2 Dir(s)  81,455,693,824 bytes free
> DISCLAIMER:
>  The information in this message is confidential and may be legally
> privileged. It is intended solely for the addressee.  Access to this message
> by anyone else is unauthorised.  If you are not the intended recipient, any
> disclosure, copying, or distribution of the message,  or any action or
> omission taken by you in reliance on it, is prohibited and may be unlawful.
> Please immediately contact the sender if you have received this message in
> error.
>  Thank you.
>  Valid Information Systems Limited.   Address:  Morline House,  160 London
> Road,  Barking, Essex, IG11 8BB. 
> http://www.valinf.com Tel: +44 (0) 20 8215 1414 Fax: +44 (0) 20 8215 2040 
> -----------------------------------------
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Mime
View raw message