WebFinder! is a small search engine for the old-school Web. The crawler starts from a handful of seed URLs and follows the links it finds, building an index page by page.
Anything the crawler can fetch as plain HTML. Pages that don't return HTML, time out, or have no extractable text are skipped, but everything else makes it into the index.
| Pages indexed: | 159 |
| URLs in queue: | 2,459 |
Know a page worth indexing? Submit it. The crawler will pick it up on its next run.