The first time it happened with only three or four crawlers.
At later times, about eight were running.
Today, there was some error output:
at net.yacy.cora.federate.solr.connector.MirrorSolrConnector.add(MirrorSolrConnector.java:204)
at net.yacy.search.index.Fulltext.putDocument(Fulltext.java:370)
at net.yacy.search.index.Segment.putDocument(Segment.java:556)
at net.yacy.search.index.Segment.storeDocument(Segment.java:639)
at net.yacy.search.Switchboard.storeDocumentIndex(Switchboard.java:3468)
at net.yacy.search.Switchboard.storeDocumentIndex(Switchboard.java:3382)
at net.yacy.search.Switchboard$7.process(Switchboard.java:1058)
at net.yacy.search.Switchboard$7.process(Switchboard.java:1054)
at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:72)
at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:82)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:680)
at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:694)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1613)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1608)
at org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:969)
at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:341)
at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:288)
at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:235)
... 45 more
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
The command invoked that was shown under ps
is
yacy 5525 259.7 27.2 2969172 984388 15 INJ 22:39 124:20.38 /usr/local/openjdk8-jre/bin/java -Xms90m -Xmx600m -server -Djav
I
'l like to answer about memory, but it seems that I cannot start anymore the service.
When tried to start it, got
>> YaCy started as daemon process. Administration at http://localhost:8090 <<
70_search@70_search:~/yacy $ W 2022/04/18 23:41:57 Cache file and metadata size is not equal, starting a cleanup thread...
W 2022/04/18 23:42:00 BROWSER System unknown
W 2022/04/18 23:42:09 YACY rejected bad yacy news record (3): attributes length (1026) exceeds maximum (974)
W 2022/04/18 23:42:40 YACY rejected bad yacy news record (3): attributes length (1026) exceeds maximum (974)
Control+C