1 -Document parser class
1 -doodle-crawlPage.zip
2 -Loading the HTML of a site
2 -doodle-domDocumentParser.zip
3 -Echoing the found urls
3 -doodle-echoUrls.zip
4 -Ignoring links we dont want to use
4 -doodle-ignoreLinks.zip
5 -Converting relative links to absolute links - Part 1
5 -doodle-createLinks1.zip
6 -Converting relative links to absolute links - Part 2
6 -doodle-createLinks2.zip
7 -Recursively crawling links
7 -doodle-recursiveCrawl.zip
8 -Getting the title tags for each site
8 -doodle-titlesPart2.zip
9 -Getting the keywords and description
9 -doodle-metaTags.zip
10 -Creating our database
10 -doodle-configFile.zip
11 -Inserting the sites to the database
11 -doodle-insertLinks.zip
12 -Checking if a link exists in the DB already
12 -doodle-linkExists.zip
13 -Crawling images
13 -doodle-crawlImages.zip
14 -Inserting images to the DB
14 -doodle-insertImages.zip