You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
yacy_search_server/source/net/yacy/crawler
luccioman db3b9db9c2
Crawl from local file : faster task end when manually terminating crawl.
9 years ago
..
data Fixed shutdown for crawler.MaxActiveThreads value greater than 200 9 years ago
retrieval Fixed redirected URLs processing as crawl start point. 9 years ago
robots CrawlCheck_p.html : also display info about disallowed URLs. 9 years ago
Balancer.java removed warnings 10 years ago
CrawlStacker.java Crawl from local file : faster task end when manually terminating crawl. 9 years ago
CrawlStarterFromSraper.java Advanced Crawl from local file : better processing of large files. 9 years ago
CrawlSwitchboard.java remove wrong log line in CrawlSwitchboard 9 years ago
FileCrawlStarterTask.java Crawl from local file : faster task end when manually terminating crawl. 9 years ago
HarvestProcess.java fix for wrong display of error urls in HostBrowser 13 years ago
HostBalancer.java one more replacement to use cached hosthash vs. calculated 9 years ago
HostQueue.java to prevent crawler to concurrently access and alter same crawl queue 9 years ago
IllegalCrawlProfileException.java Crawl from local file : faster task end when manually terminating crawl. 9 years ago
LegacyBalancer.java use supplied url port to get robots.txt in crawlers hostqueue 9 years ago
RecrawlBusyThread.java init Recrawl job chunk size to max crawl loader during job start, to use some system preferences 10 years ago