Hello, I’m new here and new using YaCy.
I launched the crawler in some webs. In one particular web the crawler is been stuck in a loop all day. It got an URL, and [the same URL] + [a suffix like %25252525…Redirect], then [URL] + [2 times the suffix] and again… All the URLs and URLs plus suffix link to the same page. It went all day long and I have around 18GBs of space used by YaCy.
So I have a very corrupted index I guess. I terminated the crawler and tried to remove the index of that website in “Index Administration” > Get top X domains from all URLs > Delete all (for that domain)
But this didn’t free any of the disk usage. How can I remove all the data from that site?
Sorry English is not my first language and I’m very newbie to YaCy.