JSpider - a Web Spider Engine
Project Rank in Web Crawlers:  7
JSpider is:
- A highly configurable and customizable Web Spider engine.
- Developed under the LGPL Open Source license
- In 100% pure Java
You can use it to :
- Check your site for errors (internal server errors, ...)
- Outgoing and/or internal link checking
- Analyze your site structure (creating a sitemap, ...)
- Download complete web sites
- Any task you want, if you write a JSpider plugin.
See Other Best Web Crawlers Projects in Java:
|
