You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Michael Peter Christen 06afb568e2 new Strategies in Balancer: ... - doublecheck cache now records the crawl depth as well - doublecheck cache is available from the outside (made static) - no more need to crawl hosts with lowest depth first, instead all hosts which have only singleton entries are preferred to reduce the number of files.		11 years ago
..
data	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago
retrieval	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago
robots	new Strategies in Balancer:	11 years ago
Balancer.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago
CrawlStacker.java	fix for bad/missing values of size_i	11 years ago
CrawlSwitchboard.java	enhanced concurrent loading by using a fixed set of concurrent loader	11 years ago
HarvestProcess.java	fix for wrong display of error urls in HostBrowser	13 years ago
HostBalancer.java	new Strategies in Balancer:	11 years ago
HostQueue.java	new Strategies in Balancer:	11 years ago
LegacyBalancer.java	- added a new Crawler Balancer: HostBalancer and HostQueues:	11 years ago