I'm trying to create a crawled index of our intranet site. When the
index is generating it keeps going for around 100Mb of files and then
crashes web services. I can only get services back by restarting
tomcat and apache. I have tweaked some of the index settings and I
think it is something to do with file size. That is if I limit the
size of the file to be indexed it crashes much sooner. If I restrict
the file types it indexes much more.

I'm sure there is a log file somewhere with a very helpful message in
it but I have checked messages and the logs for apache, tomcat and
qsearch and can't see anything.