projects / arachne.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 5399707) | patch
Remember crawled pages and don’t crawl them again.
authorDavid ‘Bombe’ Roden <bombe@pterodactylus.net>
Mon, 16 Mar 2009 23:09:47 +0000 (00:09 +0100)
committerDavid ‘Bombe’ Roden <bombe@pterodactylus.net>
Mon, 16 Mar 2009 23:09:47 +0000 (00:09 +0100)
commit83a84def68ebc8d094bc9837ec72b5fc5cfdd782
tree1acc66ab70c798f1ca5c4adb036907373578e613tree | snapshot
parent53997073cbd99e3f02773c2bdf7edad04cb0dbf7commit | diff
Remember crawled pages and don’t crawl them again.
Don’t add pages that are already scheduled for crawling.
src/net/pterodactylus/arachne/core/Core.java diff | blob | history
Arachne – A Spider for Freenet Sites (defunct)