I’m trying to understand Kelondro, database system used in YaCy.
Recently, I modified the logging in a way, that all the Kelondro operations are marked KELONDRO, so it’s more easy to debug.
Here are my initial remarks, if you know more about it, please add! Hope it will become docs page afterwards…
Kelondro
Kelondro is a database system, used in YaCy, which stores the data in
bunches of files.
It is used for RWI index, Citation Index, Bookmarks etc storage on a local host.
All the log entries associated with it’s operation are marked KELONDRO in
the log.
System is made for rotational disks, trying to minimize costly IO. Data are
dumped in small files first, and merged into larger files afterwards, on
the background or during start-up (IO and memory heavy operation).
If a system had crashed or switched-off abruptly, indexes has to be
regenerated upon startup, which may be time and IO consuming, depending on
the size of files.