descriptionArachne – A Spider for Freenet Sites (defunct)
ownerDavid ‘Bombe’ Roden
last changeMon, 16 Mar 2009 23:10:59 +0000 (00:10 +0100)
Arachne was supposed to be a spider for Freenet sites.
It was never completed and does not work.
2009-03-16 David ‘Bombe... Log hash after fetching. master
2009-03-16 David ‘Bombe... Don’t try to parse when no parser was found.
2009-03-16 David ‘Bombe... Use different executor for URL fetcher.
2009-03-16 David ‘Bombe... Remember crawled pages and don’t crawl them again.
2009-03-15 David ‘Bombe... Don’t add a page if it’s not a valid freenet page.
2009-03-15 David ‘Bombe... Add collected pages after URL fetcher is done.
2009-03-15 David ‘Bombe... Implementated adding a page by URL.
2009-03-12 David ‘Bombe... Fix javadoc tags.
2009-03-10 David ‘Bombe... Add SQL table creation scripts.
2009-03-10 David ‘Bombe... Use a default parser factory in the core and hand it...
2009-03-10 David ‘Bombe... Add parser factory.
2009-03-10 David ‘Bombe... Use lower-case project name.
2009-03-09 David ‘Bombe... Remember title when parsing URL.
2009-03-09 David ‘Bombe... Remove core dependency.
2009-03-09 David ‘Bombe... Move methods to convert to and from URL to Page.
2009-03-09 David ‘Bombe... Create message digest in core and hash fetched URLs.
11 years ago master