Computers as an Expressive Medium Lab 7: Recursion, Web Crawling, and You Mayhew Seavey

Today’s Nonsense Recursion – Why is my head spinning? Web Crawling – Recursing in HTML

Recursion Recursion basically means calling a method from inside itself. What the?!? int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1;

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3)

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 2)

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 2) int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 1)

Inside Itself?! Let’s step through what happens. 1 factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 2) 1

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) int factorial(int n) { if(n > 1) { return n * 1; } else return 1; (n = 2)

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) int factorial(int n) { if(n > 1) { return 2 * 1; } else return 1; (n = 2)

Inside Itself?! Let’s step through what happens. 2 factorial(3); int factorial(int n) { if(n > 1) { return n * factorial(n-1); } else return 1; (n = 3) 2

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return n * 2; } else return 1; (n = 3)

Inside Itself?! Let’s step through what happens. factorial(3); int factorial(int n) { if(n > 1) { return 3 * 2; } else return 1; (n = 3)

Inside Itself?! Let’s step through what happens. factorial(3); 6

Base Case The most important thing to include in a recursive call is the “base case”, something that will assure that the function stops calling itself at some point. In our example, we made sure it only called the recursive function if n was greater than 1, and each time we call it, n gets smaller, so we know it will eventually get to a number less than or equal to 1.

Web Crawling Let’s use recursion for something more interesting. Say we have some method “parsePage”, that looks at a web page. Suppose we then want that method to follow the links on that page and parse the pages it is linked to. We’d then want to call the “parsePage” method on those links from inside the parsePage method we have.

Web Crawling

Web Crawling

Web Crawling You can see here the need for a base case. One way of controlling our search is by placing a limit on the depth of the links we follow. For instance, in the visual example, we followed the links from our start page (depth 1), and then the links from those pages (depth 2).

End of Slides Recursion is a slippery slope. Web crawling is a glorious ride. Let’s take a closer look now at that HTML Parser code from lecture, which uses recursion in the way we just talked about.