Hi, what would be the minimum hardware requirements to run a decent size node of the network? What % of the files should it be able to index, etc? Disk, ram, cpu, internet connection. Is there any statistics on this?
Best regards!
Hardware / Node Details
- Server: HP DL360 Gen8 (2012-era)
- RAM: 384 GB
- Storage: 9 TB SSD
- YaCy index size & usage:
- 55.4 M docs → ~1.375 TB on disk, 128 GB RAM
- 67.0 M docs → ~1.455 TB on disk, 128 GB RAM
Observation
Despite plenty of RAM/SSD, search is slow. Likely bottleneck is the older 2012 CPU platform (Gen8 Xeon) rather than memory or disk. YaCy/Lucene query phases lean heavily on CPU latency and single-threaded sections, so newer micro-architecture makes a noticeable difference even at the same clocks.
I only have 50 mbits internet which can be swamped at times when crawling.
3 Likes
Almost any modern server hardware, but a lot of RAM helps a lot, SSD disks too.
3 Likes