8 Commits (f748b0aa7c0cf5f9a7e9950411637ea618c84ffc)

Author	SHA1	Message	Date
Michael Peter Christen	8f3bd0c387	fix for smb crawl situation (lost too many urls)	13 years ago
Michael Peter Christen	7c3de8b4cd	- fix for localhost detection ... - added IPv6 patterns for localhost detection	13 years ago
Michael Peter Christen	10527e28ae	fix for wrong display of error urls in HostBrowser	13 years ago
Michael Peter Christen	2d9e577ad0	replaced the custom robots.txt loader by the standard http loader	13 years ago
Michael Peter Christen	5f0ab25382	removed the option to prevent removal of & parts inside of the ... MultiProtocolURI during normalform computation because that should always be done and also be done during initialization of the MultiProtocolURI Object. The new normalform method takes only one argument which should be 'true' unless you know exactly what you are doing.	13 years ago
Michael Peter Christen	1533bfd63b	refactoring	13 years ago
Michael Peter Christen	8219a445f3	refactoring	13 years ago
Michael Peter Christen	00c1c777fa	refactoring	13 years ago