lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul <p...@waite.net.nz>
Subject Re: Not deleting temp files after updating/optimising.
Date Thu, 15 Apr 2004 19:55:30 GMT
This looks like the same problem I am having - see subject: "Optimize
Crash". So far I have had no reply from anyone on this list, nor from
the dev list.

If you catch errors to a log do you see the same one I reported?

The temporary workaround is to NOT optimise at all. This will impact
the search performance marginally, but at least will save you from
running out of disk.

Cheers,
Paul.



Paul Williams wrote:
> Hi,
>
> I am currently using Java 1.4.2_03 with Lucene 1.3 Final. I am using the
> option setUseCompoundFile(true) as I have a lot of fields in the database
> schema, and it can cause the dreaded 'too many open file error' on Windows
> based systems. (Optimising after 1000 documents with a merge factor of a
> 100)
>
> But I am having a problem with updating a reasonable sized index. It seems
> to leave temporary files which can treble the size of the index on the hard
> disk. (You can delete these file afterwards with no ill effects)
>
> I have checked to make sure no other processes are locking these files
> (virus checker/backup software etc.)
>
> See the directory listing below for the index files.
>
> Has anyone else had a similar problem? And hopefully come up with a
> solution!!
>
> Regards,
>
> Paul
>
> 15/04/2004  11:05       <DIR>          .
> 15/04/2004  11:05       <DIR>          ..
> 15/04/2004  10:55                    4 deletable
> 15/04/2004  11:05                    0 dir.txt
> 15/04/2004  10:55                   76 segments
> 11/04/2004  09:22          516,150,272 _11au.fdt
> 11/04/2004  09:22               12,288 _11au.fdx
> 11/04/2004  09:19                1,169 _11au.fnm
> 11/04/2004  15:00        3,969,914,880 _12nq.fdt
> 11/04/2004  15:00              283,648 _12nq.fdx
> 11/04/2004  14:39                1,169 _12nq.fnm
> 14/04/2004  17:14        5,689,259,942 _15ar.cfs
> 15/04/2004  10:17                5,462 _15ar.del
> 14/04/2004  17:19            8,619,569 _15e0.cfs
> 15/04/2004  10:12                   21 _15e0.del
> 15/04/2004  07:58              563,730 _15es.cfs
> 15/04/2004  08:25              394,474 _15fg.cfs
> 15/04/2004  10:18              663,616 _15g5.cfs
> 15/04/2004  10:55                9,385 _15g9.cfs
> 10/04/2004  16:06          939,758,592 _vas.fdt
> 10/04/2004  16:06               25,600 _vas.fdx
> 10/04/2004  16:01                1,169 _vas.fnm
> 10/04/2004  16:23          656,837,632 _vuu.fdt
> 10/04/2004  16:23               23,552 _vuu.fdx
> 10/04/2004  16:20                1,169 _vuu.fnm
> 10/04/2004  17:39           98,271,232 _y6h.fdt
> 10/04/2004  17:38                2,048 _y6h.fdx
> 10/04/2004  17:38                1,169 _y6h.fnm
> 10/04/2004  17:42           76,907,520 _y9k.cfs
> 10/04/2004  17:42                1,060 _y9k.f1
> 10/04/2004  17:42                1,060 _y9k.f10
> 10/04/2004  17:42                1,060 _y9k.f100
> 10/04/2004  17:42                1,060 _y9k.f101
> 10/04/2004  17:42                1,060 _y9k.f102
> 10/04/2004  17:42                1,060 _y9k.f103
> 10/04/2004  17:42                1,060 _y9k.f104
> 10/04/2004  17:42                1,060 _y9k.f105
> 10/04/2004  17:42                1,060 _y9k.f106
> 10/04/2004  17:42                1,060 _y9k.f107
> 10/04/2004  17:42                1,060 _y9k.f108
> 10/04/2004  17:42                1,060 _y9k.f109
> 10/04/2004  17:42                1,060 _y9k.f11
> 10/04/2004  17:42                1,060 _y9k.f110
> 10/04/2004  17:42                1,060 _y9k.f111
> 10/04/2004  17:42                1,060 _y9k.f112
> 10/04/2004  17:42                1,060 _y9k.f113
> 10/04/2004  17:42                1,060 _y9k.f114
> 10/04/2004  17:42                1,060 _y9k.f115
> 10/04/2004  17:42                1,060 _y9k.f116
> 10/04/2004  17:42                1,060 _y9k.f117
> 10/04/2004  17:42                1,060 _y9k.f118
> 10/04/2004  17:42                1,060 _y9k.f119
> 10/04/2004  17:42                1,060 _y9k.f12
> 10/04/2004  17:42                1,060 _y9k.f120
> 10/04/2004  17:42                1,060 _y9k.f13
> 10/04/2004  17:42                1,060 _y9k.f14
> 10/04/2004  17:42                1,060 _y9k.f15
> 10/04/2004  17:42                1,060 _y9k.f16
> 10/04/2004  17:42                1,060 _y9k.f17
> 10/04/2004  17:42                1,060 _y9k.f18
> 10/04/2004  17:42                1,060 _y9k.f19
> 10/04/2004  17:42                1,060 _y9k.f2
> 10/04/2004  17:42                1,060 _y9k.f20
> 10/04/2004  17:42                1,060 _y9k.f21
> 10/04/2004  17:42                1,060 _y9k.f22
> 10/04/2004  17:42                1,060 _y9k.f23
> 10/04/2004  17:42                1,060 _y9k.f24
> 10/04/2004  17:42                1,060 _y9k.f25
> 10/04/2004  17:42                1,060 _y9k.f26
> 10/04/2004  17:42                1,060 _y9k.f27
> 10/04/2004  17:42                1,060 _y9k.f28
> 10/04/2004  17:42                1,060 _y9k.f29
> 10/04/2004  17:42                1,060 _y9k.f3
> 10/04/2004  17:42                1,060 _y9k.f30
> 10/04/2004  17:42                1,060 _y9k.f31
> 10/04/2004  17:42                1,060 _y9k.f32
> 10/04/2004  17:42                1,060 _y9k.f33
> 10/04/2004  17:42                1,060 _y9k.f34
> 10/04/2004  17:42                1,060 _y9k.f35
> 10/04/2004  17:42                1,060 _y9k.f36
> 10/04/2004  17:42                1,060 _y9k.f37
> 10/04/2004  17:42                1,060 _y9k.f38
> 10/04/2004  17:42                1,060 _y9k.f39
> 10/04/2004  17:42                1,060 _y9k.f4
> 10/04/2004  17:42                1,060 _y9k.f40
> 10/04/2004  17:42                1,060 _y9k.f41
> 10/04/2004  17:42                1,060 _y9k.f42
> 10/04/2004  17:42                1,060 _y9k.f43
> 10/04/2004  17:42                1,060 _y9k.f44
> 10/04/2004  17:42                1,060 _y9k.f45
> 10/04/2004  17:42                1,060 _y9k.f46
> 10/04/2004  17:42                1,060 _y9k.f47
> 10/04/2004  17:42                1,060 _y9k.f48
> 10/04/2004  17:42                1,060 _y9k.f49
> 10/04/2004  17:42                1,060 _y9k.f5
> 10/04/2004  17:42                1,060 _y9k.f50
> 10/04/2004  17:42                1,060 _y9k.f51
> 10/04/2004  17:42                1,060 _y9k.f52
> 10/04/2004  17:42                1,060 _y9k.f53
> 10/04/2004  17:42                1,060 _y9k.f54
> 10/04/2004  17:42                1,060 _y9k.f55
> 10/04/2004  17:42                1,060 _y9k.f56
> 10/04/2004  17:42                1,060 _y9k.f57
> 10/04/2004  17:42                1,060 _y9k.f58
> 10/04/2004  17:42                1,060 _y9k.f59
> 10/04/2004  17:42                1,060 _y9k.f6
> 10/04/2004  17:42                1,060 _y9k.f60
> 10/04/2004  17:42                1,060 _y9k.f61
> 10/04/2004  17:42                1,060 _y9k.f62
> 10/04/2004  17:42                1,060 _y9k.f63
> 10/04/2004  17:42                1,060 _y9k.f64
> 10/04/2004  17:42                1,060 _y9k.f65
> 10/04/2004  17:42                1,060 _y9k.f66
> 10/04/2004  17:42                1,060 _y9k.f67
> 10/04/2004  17:42                1,060 _y9k.f68
> 10/04/2004  17:42                1,060 _y9k.f69
> 10/04/2004  17:42                1,060 _y9k.f7
> 10/04/2004  17:42                1,060 _y9k.f70
> 10/04/2004  17:42                1,060 _y9k.f71
> 10/04/2004  17:42                1,060 _y9k.f72
> 10/04/2004  17:42                1,060 _y9k.f73
> 10/04/2004  17:42                1,060 _y9k.f74
> 10/04/2004  17:42                1,060 _y9k.f75
> 10/04/2004  17:42                1,060 _y9k.f76
> 10/04/2004  17:42                1,060 _y9k.f77
> 10/04/2004  17:42                1,060 _y9k.f78
> 10/04/2004  17:42                1,060 _y9k.f79
> 10/04/2004  17:42                1,060 _y9k.f8
> 10/04/2004  17:42                1,060 _y9k.f80
> 10/04/2004  17:42                1,060 _y9k.f81
> 10/04/2004  17:42                1,060 _y9k.f82
> 10/04/2004  17:42                1,060 _y9k.f83
> 10/04/2004  17:42                1,060 _y9k.f84
> 10/04/2004  17:42                1,060 _y9k.f85
> 10/04/2004  17:42                1,060 _y9k.f86
> 10/04/2004  17:42                1,060 _y9k.f87
> 10/04/2004  17:42                1,060 _y9k.f88
> 10/04/2004  17:42                1,060 _y9k.f89
> 10/04/2004  17:42                1,060 _y9k.f9
> 10/04/2004  17:42                1,060 _y9k.f90
> 10/04/2004  17:42                1,060 _y9k.f91
> 10/04/2004  17:42                1,060 _y9k.f92
> 10/04/2004  17:42                1,060 _y9k.f93
> 10/04/2004  17:42                1,060 _y9k.f94
> 10/04/2004  17:42                1,060 _y9k.f95
> 10/04/2004  17:42                1,060 _y9k.f96
> 10/04/2004  17:42                1,060 _y9k.f97
> 10/04/2004  17:42                1,060 _y9k.f98
> 10/04/2004  17:42                1,060 _y9k.f99
> 10/04/2004  17:41          193,259,415 _y9k.fdt
> 10/04/2004  17:41                8,480 _y9k.fdx
> 10/04/2004  17:41                1,169 _y9k.fnm
> 10/04/2004  17:42            3,594,942 _y9k.frq
> 10/04/2004  17:42           11,449,010 _y9k.prx
> 10/04/2004  17:42               35,403 _y9k.tii
> 10/04/2004  17:42            2,577,708 _y9k.tis
>              154 File(s) 12,168,762,715 bytes
>                2 Dir(s)  81,455,693,824 bytes free
> DISCLAIMER:
>  The information in this message is confidential and may be legally
> privileged. It is intended solely for the addressee.  Access to this
> message by anyone else is unauthorised.  If you are not the intended
> recipient, any disclosure, copying, or distribution of the message,  or any
> action or omission taken by you in reliance on it, is prohibited and may be
> unlawful. Please immediately contact the sender if you have received this
> message in error.
>  Thank you.
>  Valid Information Systems Limited.   Address:  Morline House,  160 London
> Road,  Barking, Essex, IG11 8BB.
> http://www.valinf.com Tel: +44 (0) 20 8215 1414 Fax: +44 (0) 20 8215 2040
> -----------------------------------------
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org

-- 
Get in touch with your feelings of hostility against the dying light.
		-- Dylan Thomas [paraphrased periphrastically]

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Mime
View raw message