This class can be used to crawl Web pages to search for given text in it. It retrieves a given Web page and searches for links contained in it. The new links that are found are added to a queue to be crawled later and so implement recursive searching up to a given depth limit. The class looks for pa... Read more
FreewareVersion: 1
Platform: Linux, Windows, Mac OSX, Sun Solaris, FreeBSD
Updated Date: 11 Dec, 2009
This package can be used to find broken links in Web site pages. First, it retrieves the list of all pages of the Web site, either static pages or dynamic pages generated from data stored in a database. Then it checks the links in each of the pages to verify if they are on the list. Links to externa... Read more
FreewareVersion: 1
Platform: Linux, Windows, Mac OSX, Sun Solaris, FreeBSD
Updated Date: 11 Dec, 2009