Well...

I have been very busy the past couple of days, trying to perfect the first release of, what will be known as, CRAWLER!

CRAWLER is a web crawler or 'spider' used to search a web page, find all the links on the page, then search the pages located at the links found. During all of this searching, the crawler will add (or index) every URL/URI to some sort of storage location.

Then, if you create a search engine, you can use the data obtained from the crawler to compare keywords with...

This might sound complicated, but for those who need it. This is a very useful web application! CRAWLER is ran through the PHP command line interface and keeps searching for links until no new links are found.

I am releasing CRAWLER as open source, instructions etc are inside the ZIP file. All I ask is that you keep the copyright intact for each file you are using.

To download CRAWLER V0.1, click here!

I hope you enjoy using CRAWLER, more updates will be released for it when have the time. Although no one is stopping you from editing the source yourself

Another successful project!