Hi there.
When I run searches, most of the results come from the crawls that I have performed.
I was under the impression that when you do crawls, the crawls can often go well beyond the initial website that you crawl. This results in a larger number fo results related to the original qwebsite results.
But, when I do a search, more that half the results come form my own crawls.
How to get results past my initial crawls?
Thanks
Check Administration → Access Rate Limits. The default Peer-to-Peer Search limits are quite low (1 search per 3 seconds, 6 per minute for unauthenticated users). When these limits are exceeded, YaCy automatically falls back to searching only the local peer index, so searches may return mostly results from your own crawls.
One thing I have observed is that increasing these limits too much can have side effects. In my own testing, when the peer-to-peer search limits were raised significantly, the number of connected Senior peers dropped to around 90 peers, and increasing the limits further caused the count to fall even lower.
The reason is that many YaCy peers run with fairly conservative default rate limits to protect their systems from excessive load. If your peer starts sending a large number of remote search requests, some peers may throttle responses or become less useful as search partners.